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History  has  demonstrated  that  there  is  a pressing  need  for  improved  selection, 
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Specifically,  this  documeht>presents  empirical  evidence  which  demonstrates  that 
a program  can  be  developed  to  select  pilots  who  will  be  effective  in  air-to-air 
combat.  y SucU  £»  •Sf  it'vo-l  '2, 

The  development  of  a selection  program  of  this  nature  requires  the  execution  of 
several  phases.  These  phases  include-^'a  job  analysis  of  the  fighter  pilot  task, 
the  generation  of  testable  trait  hypotheses,  the  development  of  predictor  vari- 
ables and  peacetime  and  combat  criteria,  and  validation  and  cross  validation 
during  peacetime  and  during  combat. In  this  study,  an  extensive  and  comprehen- 
sive job  analysis  was  performed,  hypotheses  were  established,  selection  tools 
were  assessed,  peacetime  and  combat  criteria  were  reviewed,  and  programs  were 
outlined  for  the  execution  of  the  peacetime  arid  combat  validation  phases. 

From  reviews' of  U.S.  and  foreign  selection  research  dating  from  World  War  II  to 
the  present  and  an  assessment  of  pilot  opinion  from  hundreds  of  aces,  45  factors 
were  identified  potential  predictor^of  combat  effectiveness.  Of  these  45 
factors,  only  lO'Tere  adequately  evaluated  within  a current  U.S.  military  selec- 
tion program  upon  initial  entrance  into  pilot  training.  Assessment  of  the  35 
untapped  factors  is  within  *b«r  technological  reach,  in  fact,  many  of  these 
factors  can  be  assessed  by  tests  which  are  presently  available.  — 

An  Air  Combat  Effectiveness  Study  (ACES)  program  is  recommended  which  would 
provide  selection  test  measures  for  virtually  all  of  the  factors  identified  as 
underlying  combat  effectiveness.  As  part  of  the  ACES  orogram,  selection  test 
measures  would  be  correlated  with  performance  in  air  combat  maneuvering  ranges, 
thereby  providing  a method  for  selecting  fighter  pilots  during  peacetime.  Also 
included  in  the  ACES  program  is  a combat  data  acquisition  and  validation  plan. 

Armed  with  these  selection  test  scores  and  an  effectively  executed  validation 
program,  researchers  will,  for  the  first  time  in  history,  be  able  to  specify  a 
definitive  profile  of  the  ace  fighter  pilot. 
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Paradigm  for  an  Air-to-Air  Combat  Effectiveness  Selection  Program. 


Air-to-Air  Combat  Effectiveness  Feasibility  Study. 


This  Figure  Shows  the  Number  of  Eighth  Air  Force  Pilots  with  Air-to-Air  Kills  Ranging 
from  1/2  Kill  to  31  Kills  Against  the  Germans  in  World  War  II  (From  Final  Report  of 
Assessed  Fighter  Claims  Against  Enemy  Aircraft,  August  1942  - April  1945;  Published 
September,  1945)  

This  Figure  Shows  Korean  War  MIG-15  Kills  for  800  USAF  F-86  Pilots  Each  of  Whom  Had 
at  Least  25  Counter-Air  Missions  (Drawn  from  Statistical  Kill  Summary  Shown  in 
Torrance,  ei  4I,  1957.) 


Quick  Guide  to  Major  Sections  of  this  Report 


Pilot  Organizations  and  Response  Frequencies  to  the  Pilot  Questionnaire  Used  in  This 
Study 


Various  "Policy"  Issues  in  Our  Questionnaire  to  Pilots 


Pilot  Opinion  of  the  Concept  of  the  Universally  Assignable  Pilot 


Pilot  Opinion  Concerning  a Multi-Track  Training  System 


Pilot  Opinion  Concerning  Dedicating  Pilots  to  Certain  Missions  and  to  a Special  Career 
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Maneuvering  Range  Training  
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Attrition  Rates  of  UPT  Students  as  a Function  of  Entry  Source  (FY  1969). 


Pilot  Opinion  on  the  Effect  of  Out-of-Cockpit  Assignments  on  Pilot  Combat  Flying  Skills. 

Aircraft  Accident  Rate  per  100,000  Flying  Hours  (Compiled  from  USAF  Accident  Bulletins 
1960-1974,  1970-1974) 

Accidents  Attributed  to  Pilot  Error  1970-1972  Due  to  Incorrect  Operation  of  Aircraft 
Systems;  Poor  Technique  in  Flight,  Poor  Technique  in  Pattern  (Compiled  from  USAF 
Accident  Bulletins,  1970-1972)  


Recent  Skill  Retention  Analyses 

Pilot  Attitudes  Concerning  the  Substitution  of  Simulator  Tinip  for  Actual  Flight  Time  for 
Various  Kinds  of  Pilot  Tasks  (Functions)  


Pilot  Opinion  About  the  Performance  of  Pilots  in  Air  Combat  Maneuvering  Ranges  and  in 
Actual  Combat 


Pilot  Opinion  Concerning  Selection  Standards  for  Pilots. 
Total  Scores  of  Top  Ten  Aces  (Taken  from  Weiss,  1966).  . 


This  Figure  Shows  a Monthly  Summary  of  Operations  Data  for  The  U.S.  Eighth  Fighter 
Command.  (Adapted  from  Official  Eighth  Fighter  Command  Document:  Johnson,  1944). 


This  Figure  Shows  the  Interquartile  Range  of  Number  of  Missions,  Sightings  as  Leader, 
Encounters  as  Leader,  Firings,  and  Kills  for  the  Typical  F-86  Pilot  in  a Tour  in  Korea 
(Adapted  from  Strawbridge  and  Kahn,  1955;  See  Text) 


Air  Force  Personnel  with  Two  or  More  Aerial  Victories  in  Southeast  Asia  (Taken  from  U.S. 
Air  Force  Combat  Victory  Credits  Southeast  Asia,  1974)  
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3.1- 7  This  Figure  Shows  the  Scores  of  the  107  Luftwaffe  Aces  with  One  Hundred  or  More  Aerial 
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1.0  EXECUTIVE  SUMMARY  AND  INTRODUCTION 
1.1  EXECUTIVE  SUMMARY 

In  World  War  II  we  sent  large  numbers  of  pilots 
to  war,  some  of  whom  survived  their  early  conbat 
engagements,  became  skilled  at  their  craft,  and  went 
on  to  become  aces  - but  they  were  the  one  in  twenty. 
Today,  uncontestably,  we  must  find  a way  to  better 
select,  train,  and  manage  our  most  valuable  resource, 
the  pilot. 

"Any  fighter  pilot"  can  tell  you  how  to  improve 
air-to-air  combat  effectiveness  - find  a good  way  to 
select  a man  for  air-to-air,  give  him  specialized 
training,  and  keep  him  in  the  cockpit.  The  Israelis 
do  it  this  way  and  claim  a 60  to  1 kill  ratio.  The 
kill  ratio  of  the  U.S.  Air  Force  in  Southeast  Asia 
was  about  2.5  to  1.  We  believe  that  it  would  be 
prudent  to  very  seriously  consider  the  changes  the 
fighter  pilots  recommend. 

The  bulk  of  this  study  is  devoted  specifically 
to  the  issue  of  finding  a better  way  of  selecting 
men  for  air-to-air  combat.  We  conclude  that  there 
is  a way  of  doing  this,  and  that  a program  could  be 
instituted  which  could  select  men  at  entry  into  the 
military  who  would  prove  to  be  effective  air-to-air 
pilots.  It  is  clear  that  there  are  large  individual 
differences  in  performance  which  are  significant 
even  when  comparable  equipi'ient  is  used.  The  combat 
effective  pilots  will  demonstrate  their  effective- 
ness, during  peacetime,  in  air  combat  maneuvering 
range  engagements.  Furthermore,  we  believe  it  is 
possible  for  these  men  to  have  the  motivational 
characteristics  of  men  who  will  fight  effectively 
in  actual  combat. 

To  do  this  job  properly,  however,  will  take 
about  five  years  of  rigorous  work,  and  cost  about 
as  much  as  a single  modem  fighter  aircraft. 

Figure  1.1-1  shows  the  paradigm  for  an  air-to- 
air  conbot  effectiveness  selection  program.  The 
following  phases  were  completed  in  this  study: 

a.  An  extensive  and  comprehensive  job  analy- 
sis of  the  fighter  pilot  using  information 


obtained  from  validity  studies,  inter- 
views, and  questionnaires. 

b.  The  development  of  testable  trait  hypoth- 
eses covering  12  content  domains. 

c.  A cost  effectiveness  analysis  of  selection 
tools  for  testing  these  trait  hypotheses. 

d.  An  evaluation  of  the  reliability  of  mea- 
sures in  simulators  and  in  air  combat 
maneuvering  ranges/instrumentations  for 
the  development  of  peacetime  criteria. 

e.  A review  of  aviation  combat  research  for 
the  development  of  combat  criteria. 

Additionally,  programs  were  outlined  for  the  execu- 
tion of  the  peacetime  and  combat  validation  phases. 

Working  from  this  paradigm,  we  generated  the 
recommendations  shown  in  Figure  1.1-2.  The  princi- 
pal work  elements  of  this  ARPA  funded  study  focused 
on  the  identification  of  those  critical  character- 
istics and  skills  which  are  thought  to  characterize 
the  combat  effective  pilot.  In  all,  five  major 
sources  of  information  were  used  to  generate  the 
integrated  profile  of  the  combat  effective  pilot 
shown  in  this  figure.  This  profile  is  based  on  our 
comprehensive  and  systematic  review  of  World  War  II, 
Korean,  and  Southeast  Asian  conflict  information 
and  deals  with  the  scientific  studies  of  combat 
aviation  and  combat  infantry  for  those  wars.  The 
U.S.  military  aviation  selection  research  from 
World  War  II  to  the  present  time  was  reviewed. 

This  literature,  which  focuses  upon  characteristics 
and  critical  skills  which  predict  success  in  flight 
training,  has  been  used  as  a source  of  hypothesis 
generation  because,  by  implication,  these  factors 
may  be  related  to  combat  effectiveness.  We  also 
reviewed  the  German  and  Japanese  World  War  II  avia- 
tion selection  research  programs  as  well  as  the  cur- 
rent Israeli  program.  Our  final  source  of  informa- 
tion came  from  373  questionnaires  which  were 
returned  to  us  by  fighter  pilots.  Significantly, 

280  of  these  returns  are  either  from  ace  aviators 
or  aviators  witn  MIG  kills  in  Southeast  Asia. 
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33  FACTORS  ARE  NOT 
AOEQUATaY  TESTED 

BIOGRAPHICAL  DATA 

4 

FOR.  A PROGRAM  IS  REQUIRED 

TO  identify  or  develop  appropriate 

TOTAL 

45 

SELECTION  TESTS  FOR  THESE  FACTORS 
AND  RELATE  TEST  SCORES  ON  THESE 
FACTORS  TO  PILOT  PERFORMANCE  IN 
kCmt  AND  IN  COMBAT. 

A»  COMBAT  EFFECTIVENESS  STUDY  (ACES)  PROGRAM 


ACES  PILOT  A»  COMBAT  MANEUVERING 
RANGE  PERFORMANCE  ASSE$S«NT  PROGRAM 


OPERATIONALLY  DEFINED,  QUANTITATIVELY  MEASURED  ASSESSMENT 
OF  THE  PILOTS  AIR-TO-AIR  COMBAT  EFFECTIVENESS 


SITUATIONAL  TESTS  AND 
RATINGS  BY  PEERS  AND  OTHERS 

• AGGRESSIVENESS 

• SELF  CONFIDENCE 

• COURAGE 

• RESPONSIBILITY  FOR  MEN 
IN  COMBAT 

• PHYSICAL  AND  COMBAT 
LEADERSHIP 

• OETERMINATtON  DESIRE 

• SELF  D6CIPLINE 

• PERFORMANCE  UNDER  STRESS 

• EMOTIONAL  CONTROL 

• ABILITY  TO  WITHSTAND 
PSYCHOLOGICAL  STRESS 

• ANXIETY  TOLERANCE 

• WILLINGNESS  TO  TAKE 
CALCULATED  RISKS 

• TEAMWORK 

• SOCIABILITY 

• INTERPERSONAL  RATING 


ACES  SELECTION  TEST  PROGRAM 

SMALL  APPARATUS  AND 
I COMBAT  JOB  SAMPLE  TESTS 

• AWILITY  TO  WITHSTAND 
PHYSIOLOGICAL  STRESS 

• FLIGHT  APTITUDE 
(GENERAL  AND  COMBAT) 

• SELECTIVE  AHENTIOH 

• DECISION  TIME 

• AURTNESS 

• INTEGRATIVE  DECISIONS 

• VISUAL  PERCEPTION 

S • MOTOR  COORDINATION 

• SPATIAL  ORIENTATION 

• SPATIAL- PERCEPTUAL 
ABILITY 

• PERCEPTUAL  SPaO 

• INSTRUMENT  READING 

• AERIAL  GUNNERY 


PAPER-AND-PENCIL 
SELECTION  TESTS 

• PILOT  COMPOSITES 

• EQUIPMENT 
KNOWLEDGE 

• PERSONALITY  STYLE 

• SATISFACTION 

• LIFE  INVENTORY 


ACES  COMBAT  CONTINGENCY  VALIDATION  PROGRAM 

SPECIFICATION  OF  THE  COMBAT  DATA  REQUIREdTo  MAKE  A^UANTITATIVE 
ASSESSKNT  OF  THE  COMBAT  EFFECTIVENESS  OF  INOIVOUAL  PILOTS. 
CONTAMINATED  BY  SUCH  ISSUES  AS  OPPORTUNITY  FOR  AIR  KILU. 

FIGURE  U-2  AIR-TO-AIR  COMBAT  EFFECTIVENESS  FEASIBILITY  STUDY 
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Using  the  data  and  inputs  from  these  five 
sources  of  information,  we  generated  the  integrated 
profile  of  the  combat  effective  fighter  pilot  which 
you  see  in  Figure  1.1-2.  In  all,  some  45  factors 
distributed  among  the  12  major  domains  can  be  rea- 
sonably hypothesized  to  be  of  predictive  value  in 
identifying  the  combat  effective  air-to-air  fighter 
pilot.  As  an  example,  of  the  45  factors  which  can 
legitimately  be  supposed  to  underlie  air-to-air 
fighter  pilot  combat  effectiveness,  35  of  them  are 
not  adequately  tested  for  by  the  U.S.  Air  Force  in 
their  entry  selection  program.’  Since  the  method- 
ology either  exists  or  is  within  our  technological 
grasp  for  testing  the  bulk  of  these  hypothesized 
predictor  variables,  we  believe  that  a prima  facie 
case  has  been  made  for  the  overall  feasibility  of 
such  a research  program. 

The  most  cost-effective  selection  test  instru- 
ment for  each  particular  hypothesized  predictor 
variable  is  also  shown  in  Figure  1.1-2.  In  all, 
five  paper-and-pencil  selection  tests,  13  small 
apparatus  or  combat  job  sample  tests,  and  situa- 
tional tests  and  ratings  for  15  predictor  variables 
are  recommended.  In  sum,  we  find  that  an  entry 
selection  program  could  test  for  33  of  the  35 
hypothesized  predictor  variables  currently  not 
adequately  tested  for  by  the  U.S.  Air  Force.  This 
constitutes  a principal  finding  of  this  study. 

As  we  follow  Figure  1.1-2,  we  see  the  defini- 
tion of  what  we  call  the  Air  Combat  Effectiveness 
Study  (ACES)  program.  Here,  looking  at  the  right 
of  the  figure,  we  have  identified  the  ACES  Selec- 
tion Test  Program  which  would  test  for  the  33 
factors  listed.  We  conceptualize  such  a selection 
test  program  as  not  being  too  dissimilar  from  the 
current  Israeli  program,  although  probably  more 
comprehensive.  Such  a selection  test  program  could 
best  be  conducted  at  a single  site,  and  candidates 
would  be  tested  during  an  estimated  seven  to  ten 
day  period. 

Once  the  selection  test  scores  have  been  col- 
lected, candidate  pilots  would  be  free  to  progress 
through  conventional  pilot  training  to  the  point 


where  a substantial  number  of  them  could  be  placed 
in  the  ACES  Pilot  Air  Combat  Maneuvering  Range 
Assessment  Program.  Here  the  pilots  would  fly 
against  specially  trained  instructor  pilots  in  a 
series  of  carefully  contrived  air  combat  scenarios. 
Operationally  defined,  quantitatively  measured 
assessment  scores  would  be  generated  as  a measure 
of  each  pilot's  combat  effectiveness. 


Once  this  phase  of  the  peacetime  program  is 
completed,  the  pilot's  combat  effectiveness  scores 
would  be  correlated  with  the  ACES  Selection  Test 
Program  Scores,  and  the  determination  made  concern- 
ing the  predictive  power  of  the  established  ACES 
Selection  Test  Program.  If,  upon  analysis,  adequate 
correlations  exist  between  some  of  the  candidate 
pilot's  selection  test  scores  and  his  performance 
during  dissimilar  air  combat  testing,  then  there 
will  exist,  during  peacetime,  a way  of  selecting 
pilots  who  will  perform  adequately  in  the  necessary 
condition  for  combat  success.  Combined  with  appro- 
priately small  selection  ratios,  the  probability  of 
picking  combat  effective  pilots  will  be  greatly 
enhanced. 


Finally,  we  have  prepared  an  ACES  Combat  Con- 
tingency Validation  Plan,  for  ultimately  we  wish  to 
relate  the  pilot's  scores  in  both  the  ACES  Selection 
Test  Program  and  the  ACES  Pilot  Air  Combat  Maneuver- 
ing Range  Performance  Assessment  Program  with  perfor- 
mance in  actual  combat.  The  combat  contingency 


’In  several  places  in  this  report,  emphasis  has 
been  placed  upon  the  Air  Force  fighter  pilot  com- 
munity. In  the  course  of  this  study,  active 
attempts  were  made  to  extract  information  about 
and  draw  conclusions  appropriate  to  both  Air  Force 
and  Naval  aviation  programs.  Generally,  this  has 
been  done,  but  for  multiple  reasons  the  document 
is  oriented  toward  the  Air  Force  community: 

1)  The  Air  Force  community  has  performed  more 
research  pertinent  to  the  questions  raised  in  the 
present  report,  particularly  with  respect  to  the 
objective  assessment  of  air-to-air  combat  effec- 
tiveness. 

(2)  The  Air  Force  is  specifically  charged  with 
the  air  superiority  mission. 

(3)  When  the  present  research  team  sought  per- 
mission to  review  Air  Force  and  Navy  entry  level 
pilot  selection  instruments.  Air  Force  officials 
afforded  us  an  opportunity  to  review  Air  Force 
selection  instruments,  specifically  the  AFOQT. 
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validation  plan  includes  a specification  of  the  com- 
bat data  required  to  make  a quantitative  assessment 
of  the  combat  effectiveness  of  individual  pilots, 
uncontaminated  by  such  issues  as  opportunity. 

While  such  an  overall  program  is  admittedly 
ambitious,  it  is,  in  our  opinion,  quite  feasible 
and  is  potentially  a very  high  payoff  program.  The 
nature  ard  size  of  the  effort  required  to  accomplish 
this  job  is  such  that  it  will  clearly  require  high 
level  endorsement  and  sponsorship. 

The  ACES  Combat  Contingency  Validation  Program 
which  we  have  sketched  out  here  is  clearly  provi- 
sional. However,  it  does  supply  a usable  departure 
point  for  a more  carefully  contrived  plan.  Air 
Force  efforts,  both  in  World  War  II  and,  particu- 
larly, Korea,  were  "reflex  actions."  In  spite  of 
this,  the  products  coming  from  both  World  War  II, 
and  particularly  the  Korean  conflict,  were  excel- 
lently conceived  and  executed.  Indeed,  they  form 
a large  basis  of  what  we  can  say  factually  about 
the  factors  contributing  to  air  combat  effectiveness. 
However,  the  researchers,  through  no  real  fault  of 
their  own,  had  only  very  limited  relevant  informa- 
tion on  the  pilots  prior  to  their  entry  into  combat. 

Contingency  planning  is  a military  fact  of  life 
which,  though  routinely  used  for  manpower  planning, 
has  not  been  applied  to  the  validation  of  pilot 
selection  instruments.  The  ACES  program  would  per- 
mit improvement  in  our  air-to-air  forces  while 
placing  us  in  a position  to  collect  data  during  a 
military  encounter,  should  such  an  occurrence  even- 
tuate. The  goal  is  simply  to  be  prepared  with  a 
contingency  plan. 

If  the  ACES  program  recommended  in  this  report 
is  implemented,  research  scientists  will  be  armed 
with  selection  test  scores  for  virtually  all  of  the 
dimensions  presumed  to  underlie  combat  effective- 
ness. Armed  with  these  test  scores  and  an  effec- 
tively executed  combat  data  acquisition  validation 
program,  the  military  aviation  research  community 
will,  for  the  first  time  in  history,  be  able  to 
specify  a definitive  profile  of  the  ace  fighter 
pilot. 
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1.2  INTRODUCTION.  RATIONALE  ftND  SCOPE 

This  study  was  initiated  and  funded  by  the 
Defense  Advanced  Research  Projects  Agency  (ARPA) 
in  response  to  renewed  DoD  interest  in  the  overall 
problem  of  combat  effectiveness  across  all  services. 
It  is  a feasibility  study  that  reviews  an  intriguing 
question:  Is  there  a way  of  predicting  who  will  be 

effective  in  combat?  While  this  question  applies 
to  all  combat  roles,  it  is  particularly  compelling 
in  cases  where  high  cost  weapons  systems,  such  as 
aircraft  and  tanks,  are  involved. 

For  this  study,  we  selected  the  issue  of 
whether  or  not  fighter  pilot  effectiveness  in  the 
air-to-air  role  could  be  predicted.  Six  reasons 
prompted  our  selection  of  fighter  pilot  effective- 
ness: (1)  the  essentiality  of  air  superiority; 

(2)  the  reality  that  in  past  wars  it  has  been  only 
the  few  who  were  truly  combat  effective;  (3)  the 
fact  that  the  overwhelming  preponderance  of  pilot 
selection  research  which  has  been  conducted  has 
been  devoted  to  predicting  success  in  flight 
training  and  not  to  predicting  success  in  combat; 

(4)  that  a ready  criterion,  in  terms  of  number  of 
air  kills,  was  available;  (5)  the  potential  useful- 
ness of  new  tools,  particularly  air  combat  maneu- 
vering ranges;  and  (6)  the  fact  that  the  McDonnell 
Douglas  Corporation  is  intimately  involved  in  vir- 
tually every  aspect  of  fighter  aircraft  systems 
effectiveness. 

The  degree  to  which  we  have  achieved  the  com- 
prehensiveness we  sought  in  this  study  is  due  in 
very  large  part  to  the  literally  hundreds  of  pilots, 
researchers,  and  archivists  who  have  taken  their 
time  to  help  us.  We  thank  them  here  and  acknow- 
ledge them  in  Appendix  l.A.  Special  thanks  is 
extended  to  Col.  James  K.  Johnson  (Ret.),  Chairman 
of  the  Board  of  the  American  Fighter  Aces  Associa- 
tion, for  his  outstanding  contribution  and  coopera- 
tion. 

1.2.1  The  Essentiality  of  Air  Supremacy  - 
The  United  States  has  been  able  to  achieve  air 
superiority  in  three  uniquely  different  kinds  of 
wars.  Senior  military  analysts  fear  that  we  may 
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be  lulled  into  complacency.  A quote  from  an  article 
by  General  B.  K.  Holloway  (1968)  serves  to  under- 
score the  fundamental  importance  of  air  supremacy  as 
well  as  to  warn  us  not  to  take  it  for  granted. 


"Twenty-six  million  living  Americans  are  vet- 
erans of  military  service,  and  most  of  them 
have  served  in  wartime.  How  many  of  these  26 
million  ever  had  to  face  an  enemy  who  held  air 
superiori ty? • • ■ 

"In  all,  probably  no  more  than  one  out  of  150, 
for  after  February  1943  the  U.S.  and  our  allies 
had  undisputed  air  superiority  in  the  Mediter- 
ranean and  Western  Europe;  after  August  of  1943 
we  had  it  in  the  Pacific... 

"In  Korea  we  won  air  superiority  twice  - from 
the  North  Korean  Air  Force  in  the  first  two 
months  of  that  war,  and  again  from  the  Chinese 
Air  Force  after  November  1950.  In  South  Viet- 
nam, our  air  superiority  has  come  by  default. 

In  North  Vietnam  it  has  yet  to  be  seriously 
challenged.  [This  article  was  written  in  1968. 

"A  generation  of  American  fighting  men  has 
almost  forgotten  what  it  is  like  not  to  have 
air  superiority  - what  it  is  like  to  lose  mo- 
bility except  by  night;  to  be  cut  off  from 
supplies  and  reinforcements;  to  be  constantly 
under  the  watchful  eye  of  enemy  reconnaissance 
aircraft;  to  be  always  vulnerable  to  strafing 
and  bombing  attacks;  to  see  one's  fighters 
and  bombers  burn  on  their  hards tands;  to  be 
outnumbered,  outgunned,  and  outmaneuvered  in 
the  air."  (pp.  3-4) 


Today,  the  need  for  combat  effectiveness  is 
more  pressing  than  ever  before.  It  is  unlikely  that 
in  our  next  war  we  will  enjoy  the  advantages  that  we 
had  during  World  War  II.  We  live  in  an  age  of 
strategic  parity.  In  our  next  war  it  is  unlikely 
that  we  will  enjoy  numerical  superiority  over  our 
enemies.  Critical  battles  may  well  have  to  be 
fought  before  we  can  bring  our  industrial  might  to 
bear. 


In  today's  arena  of  air  superiori ty, the  need 
for  combat  effectiveness  is  all  too  obvious.  We 
live  in  a time  when  we  will  be  able  to  field  only 
a relatively  small  number  of  very  expensive  air 
superiority  fighters.  In  the  words  of  General 
Dixon  (1975),  the  Commanding  General  of  the  Tactical 
Air  Command: 

"We  [USAFI  must  offset  our  numerical  inferior- 
ity with  technology  expressed  in  a higher  kill 
ratio...  *t  is  imperative. .. to  increase  to 
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the  utmost  the  combat  readiness  and  effective- 
ness of  the  command..."  (In  Ulsamer,  1975. 
pp.  32.  28) 

The  essentiality  of  air  superiority  is  cur- 
rently widely  recognized  within  the  military/indus- 
trial community  and  is  evidenced  in  advanced  air- 
craft and  avionics  design,  tests  of  air  combat 
tactics  and  missile  design  within  the  joint  Air 
Force/Navy  ACEVAL-AIMVAL  program,  the  tri service 
combat  readiness  Red  Flag  Program.'  and  the  Air 
Force  and  Navy  air  combat  maneuvering  range  train- 
ing programs  employing  dissimilar  "aggressor"  air- 
craft. A complementary  area  of  research  lies  in 
the  area  of  selecting  pilots  for  air-to-air  combat 
effecti veness. 

This  study  is  concerned  with  identifying  the 
attributes  which  are  associated  with  the  successful 
air  combat  pilot,  and  with  the  feasibility  of 
establishing  a pilot  selection  program  aimed  at 
identifying  candidate  pilots  who  will  be  combat 
effective. 

1.2.2  The  Precedent  for  the  Study  of  Combat 
Effectiveness  - A clear  precedent  exists  for  the 
scientific  study  of  the  factors  which  make  men 
fight.  In  World  War  II  this  mandate  was  issued  by 
General  George  C.  Marshall  (Stouffer.  Lumsdaine. 
Lumsdaine.  Williams.  Smith.  Janis.  Star,  and 
Cottrell.  1949).  The  very  finest  teams  of  research 
scientists  were  assembled  and  the  results  were  a 
variety  of  studies  published  shortly  after  the  war; 
The  American  Soldier  (Stouffer.  et  1949)  being 
representative  for  combat  infantry,  while  the  USAAF 
Aviation  Psychology  Program  (e.g..  Flanagan.  1948) 
and  the  Navy's  study  of  2500  combat  Navy  pilots 
entitled.  "The  Combat  Criterion"  (Jenkins.  Ewart, 
and  Carroll,  1950),  constituted  the  major  efforts 
for  combat  aviation. 

Continuation  of  this  precedent  can  be  seen  for 
the  Korean  War  in  the  Army's  "Fighter"  series  of 
studies  (Egbert,  Meeland,  Cline,  Forgy,  Spickler, 
and  Brown,  1957)  which  attempted  to  characterize  the 
factors  which  were  associated  with  infantrymen  that 
were  fighters  and  infantrymen  who  would  not  fight. 
The  Air  Force,  keenly  aware  that  a handful  of  their 
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pilots  were  doing  most  of  the  killing,  directed  the 
Air  Research  and  Development  Command  to  study  the 
characteristics  of  Korean  War  pilots  and,  if  possi- 
ble, develop  a profile  of  the  ace  (Strawbridge  and 
Kahn.  1955;  Torrance,  Rush,  Kohn,  and  Doughty,  1957). 

For  the  war  in  Southeast  Asia  the  Red  Baron 
reports  (1973,  1974)  which  examine  the  air  war 
during  that  time  frame,  continued  the  precedent  of 
the  scientific  study  of  combat  effectiveness.  From 
these  studies  and  other  sources,  it  is  possible  to 
build  a general  profile  of  what  makes  a combat 
effective  soldier  or  airman.  First,  however,  let's 
look  at  some  of  the  realities  of  combat  effective- 
ness. 


1.2.3  The  Realities  of  Combat  Effectiveness  - 
S.  L.  A.  Marshall,  a World  War  I combat  infantry 
officer  and  military  historian,  had  an  unparalleled 
opportunity  to  investigate  the  combat  effectiveness 
of  American  Infantrymen  of  World  War  II.  In  all, 
Marshall  interviewed  some  400  companies  of  infantry 
both  in  Europe  and  the  South  Pacific.  His  book. 

Men  against  Fire  (1947)  published  shortly  after 
the  war,  is  a thoughtful  and  emotional  statement 
of  his  findings  and  opinions. 

Marshall's  most  dramatic  revelation  was  that 
in  any  given  engagement  about  80?  of  American 
infantrymen  did  not  fire  their  weapons  effectively. 
This  is  astonishing  indeed,  but  so  are  the  combat 
effectiveness  records  of  fighter  pilots. 

The  German  fighter  pilots  of  World  War  II,  some 
of  whom  flew  "from  the  first  to  the  last,"  set  some 
truly  remarkable  kill  records.  Their  top  ten  pilots 
scored  a staggering  total  of  2568  kills  among  them 
(Weiss,  1966).  According  to  Hans  Ring,  the  German 
fighter  pilot  historian,  a mere  300  German  pilots 
destroyed  30,000  Russian  aircraft  (Sims,  1967). 

Most  American  pilots  fought  a much  "shorter"  war 
but  here,  too,  a wide  spread  of  scores  is  to  be 
found. 


'See  Glossary  in  Section  9.1 
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According  to  official  Eighth  Air  Force  records 
of  the  5000  fighter  pilots  who  flew  against  the 
Germans  during  1943-1945,  only  a relative  handful 
became  aces.  Of  the  5000,  only  261  (or  5.2  percent) 
achieved  this  goal.^  However,  this  small  group  of 
men  accounted  for  40  percent  of  the  total  5284.5 
German  planes  destroyed  by  the  Eighth  Air  Force 
fighter  pilots  during  that  period;  thus,  five  per- 
cent claimed  forty  percent  of  the  kills. 

The  Eighth  Air  Force  fighter  pilot  kills  record 
shown  in  Figure  1.2-1  illustrates  the  enormous  dif- 
ference in  pilot  kills.  Among  those  with  air-to- 
air  kills,  over  1000  pilots  (47.8  percent)  had  1/2 
to  1 kill,  while  57  pilots  (2.6  percent)  had  more 
than  10  kills. 

History  repeated  itself  in  the  Korean  War, for 


again  it  was  found  that  a small  percentage  of  Air 
Force  pilots  were  accounting  for  the  lion's  share 
of  the  kills.  A summary  of  the  MIG-15  kill  statis- 
tics for  800  USAF  F-86  pilots  in  the  Korean  War  is 
shown  in  Figure  1.2-2.  Here  again,  we  see  the 
largest  group  of  pilots  recording  no  kills  (53.5 
percent)  while  a small  group  of  38  pilots  (4.8  per- 
cent) were  able  to  become  aces.  Importantly,  each 
of  the  F-86  pilots  is  known  to  have  had  at  least 
25  counterair  missions  and,  therefore,  presumably, 
a fair  chance  for  a kill  (Torrance,  e^  al^,  1957). 
Clearly,  the  handful  O'^  aces  are  making  an  over- 


^These  particular  records  include  credits  given 
to  pilots  for  the  destruction  of  enemy  aircraft  on 
the  ground.  Examination  of  the  air-to-air  kills 
for  the  same  group  evidences  the  same  trend  for 
markedly  superior  performance  for  only  a handful 
of  pilots  (see  Section  3.1). 


NUMBER  OF  KILLS 


FIGURE  1.2-1  THIS  FIGURE  SHOWS  THE  NUMBER  OF  EIGHTH  AIR  FORCE 
PILOTS  WITH  AIR-TO-AIR  KILLS  RANGING  FROM  1/2  KILL  TO  31  KILLS 
AGAINST  THE  GERMANS  IN  WORLD  WAR  II.  (From  Final  Report  of  Assessed 
Fi(hter  Claims  Against  Enemy  Aircraft,  August  1942-  April  1945;  Published 
September,  1945) 
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FIGURE  1.2-2  THIS  FIGURE  SHOWS  KOREAN  WAR  MIG-15 
KILLS  FOR  800  USAF  F-86  PILOTS  EACH  OF  WHOM  HAD 
AT  LEAST  25  COUNTER-AIR  MISSIONS  (Drawn  from  Statis- 
tical Kill  Summary  Shown  in  Torrance,  ET  1957  ) 

whelming  contribution  to  air-to-air  kills;  air 
supremacy. 


li 

passes,  and  60-70  percent  of  their  firing  ji 

passes  resulted  in  kills.  Others  converted 

as  few  as  15  percent  of  their  encounters  with 

the  enemy  into  firing  passes,  and  in  some 

cases  as  few  as  0-10  percent  of  the  firing 

passes  were  converted  to  kills."  (Strawbridge 

and  Kahn,  1955,  p.71 ) 

This  study  by  Strawbridge  and  Kahn  (1955)  de- 
serves a wider  audience,  for  it  demonstrates  what 
we  know  intuitively  - that  some  pilots  are,  in  fact, 
superior  to  other  pilots  in  air-to-air  combat. 

This  study,  and  others  conducted  during  the  Korean 
period,  are  particularly  important  because  the 
issue  of  opnortunity  dominates  the  air  war  analysis 
of  Southeast  Asia.  While  the  air  war  in  Southeast 
Asia  lasted  for  a long  period  of  time  and  involved 
a large  number  of  pilots,  it  has  often  been  charac- 
terized as  "seven  one-year  wars." 

Many  pilots  who  flew  large  numbers  of  combat 
missions  in  Southeast  Asia  probably  never  encoun-  I 


The  issue  of  opportunity  for  air  kills  clouds 
the  analysis  of  kills.  However,  even  when  one  exam- 
ines the  kill  records  of  pilots  who  had  a proven 
opportunity,  we  still  see  a small  percentage  of  men 
(10  percent)  getting  the  lion's  share  of  the  kills. ^ 

Two  outspoken  critics  of  identifying  combat 
effective  pilots  by  their  kill  records  per  se  are 
Strawbridge  and  Kahn  (1955).  Their  study  is  highly 
professional  and  their  point  well  taken.  Kills  per 
opportunity**  would  certainly  be  an  admirable  "scien- 
tific" measure  of  pilot  combat  effectiveness.  Using 
the  argument  that  "combat  effectiveness  can  be  eval- 
uated only  for  those  pilots  who  had  sufficient  con- 
tact with  the  enemy,"  they  performed  an  exhaustive 
analysis  of  the  operational  flight  records  of  520 
pilots  of  the  Fourth  Fighter  Interceptor  Wing  who 
flew  combat  in  Korea  from  which  they  selected  f|9 
pilots  who,  they  felt,  had  sufficient  opportunity 
for  MIG  kills.  Each  of  the  69  pilots  they  selected 
had  15  or  more  encounters  with  the  enemy,  while 
serving  as  an  element  leader.  They  concluded: 

"Among  those  pilots  who  had  sufficient  contact 
with  the  enemy  (15  or  more  encounters),  consid- 
erable variability  in  effectiveness  is  noted. 
Some  pilots  were  able  to  convert  70-80  percent 
of  their  encounters  with  the  enemy  into  firing 


tered  enemy  fighter  aircraft.  The  total  number  of 
air  kills  in  air-to-air  combat  engagements  by  both 
Air  Force  and  Navy  during  the  entire  war  in  South- 
east Asia  totaled  only  about  200.  Because  of  Wis 
issue  of  opportunity,  most  of  the  pilots  from  the 
Southeast  Asian  conflict  who  we  guestioned  simply 
did  not  believe  that  a pilot  with  one  air  kill  sig- 
nificantly stood  above  other  pilots;  the  other 
pilots,  they  believe,  may  simply  not  have  had  a 
chance  for  a kill. 


One  area  where  luck  plays  an  undeniable,  and  ' 

perhaps  overwhelming  role,  is  in  a pilot's  first 
few  encounters.  In  a well  known  article,  Weiss 
(1966)  has  presented  data  from  three  large  air  com- 
bat units  which  portray  a very  grim  picture  of  a ; 

fledgling  pilot's  chances  for  surviving  his  first 

i 

j 

^Reexamination  of  Figure  1.2-2  and  ignoring  the 
group  of  pilots  with  no  kills,  still  reveals 
dramatic  differences  in  pilot  kill  records.  ] 

'‘Of  course  this  won't  change  the  popular  liter-  j 

ature  on  ace  pilots.  If  we  were  to  use  kills  per  ( 

sortie  then  we  would  all  know  the  name  of  the  ' 

German  pilot,  Lt.  Guenther  Scheel , who  scores  71  \ 

kills  in  70  missions  and  not  Erich  Hartmann  with 
his  352  kills  in  826  encounters  during  1405  missions  ; 
(Constable  and  Toliver,  1968).  i 
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decisive  ccxnbat  engagement.  Weiss'  data  show  that 
a pilot's  chances  for  winning  decisive  aerial 
engagements  Improves  dramatically  over  his  first 
few  engagements.  Significantly,  those  pilots  who 
survive  their  first  few  decisive  encounters  then 
evidence  a remarkably  high  probability  of  winning 
subsequent  decisive  encounters;  greater  than  a .98 
chance  of  survival 

Two  Important  points  should  be  made  with  regard 
to  these  concepts.  If  we  send  pilots  to  combat 
without  adequate  specialized  air-to-air  combat 
training*’  against  an  enemy  with  good  fliers,  then 
we  must  anticipate  high  attrition,  poor  combat 
effectiveness,  or  both,  to  occur.  If  Weiss'  analy- 
sis of  the  air  war  of  World  War  II  Is  prophetic  of 
future  conflicts,  and  if  we  can  select  and  train 
our  pilots  to  high  air-to-air  readiness,  then  we 
can  expect  to  sustain  high  kill  ratios  against  any 
opponent  without  an  equally  effective  selection, 
training,  and  pilot  management  system. 

1.2.4  Overview  of  this  Report  - The  body  of 
this  report  consists  of  Sections  2 through  7 shown 
In  overview  in  Figure  1.2-3.  Section  9 includes  a 
glossary  of  terms  and  acronyms  which  might  be  quite 
valuable  to  the  reader  not  familiar  with  terms  com- 
monly used  In  the  fighter  pilot  community.  In 
Section  2 we  discuss  the  pilots'  responses  to  the 
nine  major  policy  Issues  shown  In  Figure  1.2-3. 
Pilots'  attitudes  toward  the  universally  assignable 
pilot  are,  for  the  most  part,  very  hostile.  Also, 
the  majority  of  pilots  feel  that  a pilot's  perfor- 
mance in  air  combat  maneuvering  range  engagements 
will  be  Indicative  of  his  performance  in  combat, 
and  that  the  majority  of  pilots  feel  that  selection 
standards  should  be  more  rigorous  for  the  Identifi- 
cation of  air-to-air  fighter  pilots. 

Section  3,  which  focuses  on  identifying  the 
attributes,  i.e.,  the  characteristics  and  critical 
skills  of  the  combat  effective,  is  Introduced  by  a 
subsection  dealing  with  the  technical  Issues 
involved  in  any  appraisal  of  air  combat  effective- 
ness. Specifically,  we  briefly  review  the  Issues 
of  opportunity,  chance,  luck,  and  survival  of  the 
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fittest/experience,  as  they  relate  to  providing  a 
context  within  which  we  can  examine  air  combat 
effectiveness  data.  Section  3 comprehensively 
examines  the  scientific  studies  of  combat  aviation 
and  combat  infantry,  as  well  as  pilot  selection 
studies  for  the  prediction  of  success  In  training. 

In  addition,  a treatment  of  the  German  and  Japanese 
aviation  selection  programs  of  World  War  II,  as 
well  as  the  current  Israeli  program,  is  provided. 
Finally,  we  review  inputs  from  373  pilots  who 
responded  to  the  questionnaire  concerning  the 
characteristics  and  critical  skills  of  the  combat 
effective  fighter  pilot. 

All  of  these  sources  of  information  permit  us, 
in  Section  4,  to  develop  an  integrated  profile  of 
the  combat  effective  fighter  pilot.  The  list  which 
you  see  in  Figure  1.2-3  shows  the  12  domains  made  up 
of  45  factors  which  can  reasonably  be  supposed  to 
underlie  air-to-air  combat  effectiveness. 

As  we  have  already  suggested  in  the  Executive 
Summary,  paper-and-pencll  testing,  particularly  In 
the  Life  Inventory  area,  has  some  potential  as  an 
effective  selection  device  for  some  of  the  factors. 
In  Section  5 we  report  on  our  preliminary  efforts 
to  develop  and  “validate"  an  instrument  of  this 
type.  A preliminary  analysis  of  the  Life  Inventory 
responses  of  nearly  400  pilots  is  presented. 

The  data  developed  in  Section  6 reflect  the 
fact  that  many  of  the  factors  underlying  air  combat 
effectiveness  may  be  tested  in  an  air  combat  job 
sample  approach  to  the  problem.  Consequently,  dur- 
ing the  course  of  this  study  we  examined  represen- 
tative simulators  within  the  community  so  that  we 
could  understand  many  of  the  complex  issues  in- 
volved in  the  development  of  an  adequate  job  sample 
approach  to  selecting  for  combat  effectiveness. 


^This  makes  intuitive  sense  and  "explains"  how 
some  pilots  could  achieve  hundreds  of  kills  (see 
Section  3.1). 

^In  this  regard,  note  that  the  U.S.  Navy  kill 
ratio  in  Southeast  Asia  jumped  from  2.5  to  1 , to 
12.5  to  1,  following  initiation  of  their  Top  Gun 
school  which  trained  pilots  in  air  combat  maneuver 
ing  range  engagements  (deLeon,  1977;  see  Section 
3.1). 
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We  also  examined  air  combat  maneuvering  range/ in- 
strumentation facilities  for  the  development  of 
peacetime  criteria  of  combat  effectiveness. 

In  Section  7 of  this  document  we  perform  a 
rough  cost  effectiveness  evaluation  of  testing 
instruments  which  could  be  used  to  discriminate 
among  pilots  across  33  of  the  factors  presumed  to 
be  of  predicitive  value.  From  this  we  developed  a 
recommended  Air  Combat  Effectiveness  Study  (ACES) 
program  which,  in  overview,  provides  a description 
of  the  multi-year  selection  test  program  using 
pilot  performance  in  air  combat  maneuvering  ranges 
as  a peacetime  test  bed.  Lastly,  we  identify  the 
combat  data  requirements  associated  with  a combat 
contingency  validation.  A final  summary  of  these 
sections  may  be  found  in  Section  8. 
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2.0  PILOT  OPINION  ON  MAJOR  POLICY  ISSUES 

During  the  initial  stage  of  this  study  effort, 
two  members  of  the  research  team  - one  a behavioral 
scientist,  the  other  a combat  aviator  - visited 
with  some  15  organizations  and  talked  with  approx- 
imately 60  researchers  and  pilots  (see  Appendix 
1-A).  The  recurrent  theme  in  these  visits  was  that 
there  are  some  obvious  ways  of  improving  air-to-air 
combat  effectiveness,  but  that  many  of  them  would 
be  very  difficult  to  implement  since  they  are  not 
in  accordance  with  existing  Air  Force  policy.  It 
became  obvious  that  one  of  the  more  useful  things 
we  could  accomplish  in  the  course  of  this  study  was 
the  documentation  of  pilot  attitudes  on  significant 
"policy"  issues.  Our  rationale  was  that  if  a strong 
consensus  was  found,  and  that  if  these  attitudes 
could  be  brought  to  the  attention  of  senior  Air 
Force  policy  makers,  then  positive  change  might  be 
forthcoming. 

Accordingly,  we  distributed  735  questionnaires 
to  the  groups  shown  in  Figure  2.0-1.  In  all,  373 
pilots  responded  for  a surprising  51%  response  rate 
(typically,  questionnaire  response  rates  range  from 
20  to  25%).  Significantly,  about  two-thirds  of  the 
pilot  respondents  were  from  the  American  Fighter 
Aces  Association,  each  member  of  which  has  at  least 
five  air  combat  kills. 
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PILOT  ORGANIZATION 

NUMBER 

DISTRIBUTED 

NUMBER 

RETURNED 

PERCENT 

RETURNED 

AMERICAN  FIGHTER  ACES  ASSOCIATION 

524 

257 

49 

NAVY  MIG  KILLERS  ASSOCIATION 

RED  RIVER  VALLEY  FIGHTER  PILOTS  ASSOCIATION 

42 

22 

52 

(RIVER  RATS) 

99 

51 

51 

NATIONAL  GUARD  PILOTS 

40 

13 

33 

ACEVAL-AIMVAL  NAVY  PILOTS 

12 

12 

100 

ACEVAL-AIMVAL  AIR  FORCE  PILOTS 

6 

e 

100 

AGGRESSOR  SQUADRON  AT  NELLIS 

12 

12 

100 

TOTAL 

735 

373 

51 

FIGURE  2.0-1  PILOT  ORGANIZATIONS  AND  RESPONSE 
FREQUENCIES  TO  THE  PILOT  QUESTIONNAIRE  USED 
IN  THIS  STUDY 


This  section  of  our  report  discusses  pilot 
attitudes  concerning  the  nine  policy  issues  shown 
in  Figure  2.0-2.  The  percentage  of  pilots  agreeing 
or  disagreeing  with  specific  questions  dealing  with 
each  of  these  policy  issues  and  a selected  sampling 
of  written  responses  are  presented.  The  responses 
typify  the  positive  and  negative  attitudes  of  the 
pilot  group  concerning  each  issue. 
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THE  UNIVERSALLY  ASSIGNABLE  PILOT 

SINGLE  TRACK  VS  MULTITRACK  TRAINING 

■‘DEDICATED"  AND  “CONTRACT"  PILOTS 

COMBAT  READINESS  AND  THE  ACMR 

PILOT  FORCE  TRAINING  WITHIN  BUDGET  LIMITS 

OUT-OF-COCKPIT  EFFECTS  ON  PERFORMANCE 

SIMULATORS  SUBSTITUTING  FOR  FLIGHT  TIME 

WILL  ACMR  PILOT  PERFORMANCE  "PREDICT"  TO  COMBAT 

SHOULD  FIGHTER  PILOT  SELECTION  STANOARDS  BE  TOUGHENED 

FIGURE  2.0-2  VARIOUS  "POLICY”  ISSUES  IN  OUR 
QUESTIONNAIRE  TO  PILOTS 


2.1  THE_  UNIVERSALLY  ASSIGNABLE  _P IJ._0T 

The  question  which  evoked  the  strongest  re- 
sponse was  the  one  concerning  the  universally  as- 
signable pilot.  Figure  2.1-1  contains  a histogram 
showing  the  percent  of  pilots  who  either  strongly 
agreed,  agreed,  had  no  opinion,  disagreed,  or  strong- 
ly disagreed  with  this  concept.  Thirty-nine  percent 
of  the  pilots  strongly  disagreed  with  the  concept 
of  the  universally  assignable  pilot.  An  additional 
29%  of  the  pilots  disagreed  with  the  concept  making 
a total  of  68"  who  opposed  it.' 

The  pilot  comments  shown  in  Figure  2.1-1 
reflect  the  generalized  hostility  toward  the  concept 
of  the  universally  assignable  pilot.  Comments  from 


'These  percentages  and  those  that  will  be  re- 
ported throughout  this  section  are  for  the  entire 
pilot  sample.  When  one  looks  at  the  responses  of 
current  pilots  (i.e.,  all  groups  except  the  American 
Fighter  Aces  Association)  the  percentages  change 
somewhat.  In  this  case  89%  of  the  pilots  either  j 

disagreed  or  strongly  disagreed  with  the  concept  of  ( 
the  universally  assignable  pilot.  j 

( 

j 
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QUESTION: 

THE  CURRENT  AIR  FORCE  OKTRINE  AIMS  TOWARD  THE  SELECTION  AND 
BASIC  TRAINING  OF  PILOn  TO  THE  END  THAT  NEW  GRADUATES  CAN  BE 
ASSIGNED  TO  ANY  TYPE  AIRCRAFT  (THE  UNIVERSALLY  ASSIGNABLE 
PILOT  CONCEPT).  DO  YOU  AGREE  WITH  THIS  CONCEPT? 


agree  OPINION  DISAGREE 


SELECTED  PILOT  RESPONSES  FROM  MEN  WHO  DISAGREE  OR  STRONGLY 
D6AGREE: 


DISAGREE 

AMERICAN 
FIGHTER  ACE 


DISAGREE 

RIVER  RAT 
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- IN  SECONDARY  TRAINING  AT  PENSACOLA,  FLORIDA 
WHEN  FLYING  AIRCRAFT  LARGER  THAN  TRAINING 
AIRCRAFT  - EVERY  PILOT  WAS  GRANTED  A PRIVATE 
INTERVIEW  WITH  THE  C.O.  OF  THE  SECONDARY 
TRAINING  FACIUTY  TO  AIR  HIS  REQUEST  TO  GO 
INTO  “PATROL  AIRCRAFT”  “SCOUTING  AIRCRAFT" 

OR  "CARRIER  BASED  AIRCRAFT,"  I PERSONALLY 
REQUESTED  "CARRIER  BASED  AIRCRAFT”  AND  WAS 
GRANTED  A TRANSFER  TO  "CARRIER  TRAINING 
FACILITIES"  IN  OPE-LOCKE,  FLORIDA.  I PERSONAL- 
LY ENDORSE  THE  INDIVIDUAL  SELECTION  OF  TYPE 
AND  AREA  OF  SERVICE  RATHER  THAN  “UNIVERSALLY 
ASSIGNABLE  CONCEPT  POLICY.” 

FOR  THE  RECORD  - 

1)  I WANTED  TO  FLY  - I APPLIED  AND  WAS  ACCEPTED. 

2)  I WANTED  CARRIER  DUTY  - AND  WAS  ACCEPTED. 

3)  I WANTED  TO  BE  A FIGHTER  PILOT. 

4)  I REQUESTED  TD  BE  A FIGHTER  PILOT  AND  WAS 
ACCEPTED. 

5)  I AM  SATISFIED  WITH  MY  FIGHTER  PILOT  RECORDS. 

SCREW  THE  POOLING  OF  PILOTS  UNDER  DILETTANTE 
TITLES  LIKE  fUNIVERSALLY  ASSIGNABLE  CONCEPT 
POLICY")  - A GOOD  FIGHTER  PILOT  IS  NOT  UNIVER- 
SALLY ASSIGNABLE  - YOU  WILL  BREAK  HIS  HEART 
AND  AMBITION  TO  BE  SOMETHING  EXCEPTIONAL 
ACCORDING  TO  HIS  MILITARY  FLYING  AMBITIONS. 

DO  NOT  EVER  ADOPT  ANY  TRAINING  PROGRAM  EVER 
ANYWHERE  IN  ANY  SERVICE  WHERE  INDIVIDUAL  PILOT 
AMBITIONS  ARE  NOT  SENSIBLY  REVIEWED!!  IN  MY 
JUDGMENT  PILOT  STUDENT  AMBITIONS  AS  TO  TYPE, 

AREA  OF  SERVICE  AND  AIRCRAFT  IS  A MORALE  PRO- 
DUCING, COST  SAVING  PROCEDURE  IF  HANDLED 
CORRECTLY. 


STRONGLY 

DISAGREE 

AMERICAN 

FIGHTER  ACE 


STRONGLY 

DISAGREE 

AMERICAN 
FIGHTER  ACE 

STRONGLY 

DISAGREE 

AKRICAN 

FIGHTER  ACE 

STRONGLY 

DISAGREE 

AGGRESSOR  SQO. 


- THE  TRANSITION  FROM  FIGHTER  TO  BOMBER,  TO 
CARGO  ABE  EASIEST  IN  THAT  ORDER,  I BELIEVE 
IT  TOO  COSTLY  IN  DOLLARS,  LOGISTIC  AND 
TRAINING  EFFORTS,  AND  IN  SAFETY  TO  TRY 

TO  MAKE  A FIGHTER  PILOT  OUT  OF  A BOMBER 
OR  CARGO  PILOT  - UNLESS  THERE  IS  NO  OTHER 
CHOICE.  TO  GO  FROM  FIGHTER  TO  BOMBER  TO 
CARGO  IS  RELATIVELY  EASY  BECAUSE  LESS 
PHYSICAL  REQUIREMENTS  ARE  NEEDED.  THE 
BEST  PILOT  IS  ONE  WHO  IS  SKILLED  IN  THE  AIR- 
CRAFTS HE  FLIES  AND  THE  ENVIRONMENT  IT  IS 
TO  BE  FLOWN  IN  - CONSTANT  CHANGES  ARE  FOOL- 
ISH AND  COSTLY. 

- IN  THIS  AGE  OF  SOPHISTICATED  ARMAMENTS,  WE 
HAVE  UARNED  (USUALLY  THE  HARD  WAY)  THAT 
THERE  IS  NO  SUCH  THING  AS  A UNIVERSAL  WEAPONS 
SYSTEM.  WHY  SHOULD  THE  USAF  PURSUE  A 
“UNIVERSAL"  PILOT  CONCEPT? 

- A BOMBER  PILOT!  GEN  SPAATZ  THOUGHT  THIS  ONE  UP. 
I HAD  A FEN  PEOPLE  SELECTED  AND  TRAINED  UNDER 
THB  PRECEPT.  SOME  WERE  OK,  MOST  WERE  UNACCEPT- 
ABLE. THREE  I COULDN'T  EVEN  USE. 

THE  UNIVERSAL  PILOT  IS  A FINE  “WHOLE  MAN”  WHO 
WILL  BE  ABLE  TO  IMPRESS  THE  POOR  DUMB  SPECIAL- 
IZEO  S.O.B.  WHO  IS  SHOOTING  HMI  DOWN  WITH  THE 
FACT  THAT  HE  (THE  WHOLE  MAN)  HAS  A PHJ).  IN 
MANAGEMENT,  HAS  COMPLETED  AIR  COMWWND  AND 
STAFF  SCHOOL  AND  WOULD  BE  CAPABLE  OF  FLYING 
THE  C-141  WITH  A MINIMUM  OF  TRAINING,  IF  IT  WEREN'T 
FOR  THE  FACT  THAT  HE  WILL  BE  DEAD  IN  THE  NEXT 
30  SECONDS.  THE  UNIVERSAL  PILOT  IS  THE  UNIVERSAL 
TARGET. 


SELECTED  PILOT  RESPONSES  FROM  MEN  WHO  AGREE  OR  STRONGLY 
AGREE: 


STRONGLY 

AGREE 

AMERICAN 
FIGHTER  ACE 

AGREE 

RIVER  RAT 


AGREE 

AMERICAN 
FIGHTER  ACE 


AGREE 

AMERICAN 
FIGHTER  ACE 

AGREE 

RIVER  RAT 


- ELIMINATE  ALL  PILOTS  THAT  CANNOT  BE  ASSIGNED, 
FOR  ANY  REASON,  TO  ANY  TYPE  AIRCRAFT. 


- IDENTIFY  WHAT  TYPE  OF  AIRCRAFT  THE  INDIVIDUAL 
WANTS  TO  FLY  AFTER  HE  SOLOS  THE  T-38.  AT  THAT 
TIME  THE  PROGRAM  CAN  START  TO  BE  TAILORED. 
MORE  INSTRUMENTS  AND  LESS  FORMATION  FOR 

THE  MULTI-ENGINE  PILOTS.  MORE  INFORMATION, 
AERO,  AND  FORMATION  AERO  FOR  THE  "FIGHTER 
PILOTS." 

- I FEEL  SAME  THAT  SOMEWHERE  IN  THE  BASIC  PIPE- 
LINE, STUDENTS  ARE  EVALUATED  (CONTINUOUSLY) 
AND  GRADED  FOR  ASSIGNMENT  TO  TYPE  COMMANDS 
- CHOICE  BY  STUDENT,  TRAINING  PERFORMANCE, 
PEER  RATINGS,  MOST  ALL  MAKE  UP  A PART  OF  THE 
FINAL  ASSIGNMENT  - BUT,  ABOVE  ALL,  A STUDENT 
MOST._..WANT  TO  BE  A FIGHTER  PILOT. 

- BETTER  QUALITY  SELECTION  FROM  UPT  TO 
APPROPRIATE  CCTS. 


- BASIC  SEUCTION  AND  BASIC  TRAINING  IN  THE 
UNIVERSALLY  ASSIGNABLE  PILOT  CONCEPT  MAKES 
SENSE,  BUT  FIGHTER  PILOTS  SHOULD  BE  SELECTED 
AT  THE  END  OF  PILOT  TRAINING  AND  ALLOWED  TO 
SPECIALIZE  AS  FIGHTER  PILOTS  FROM  THEN  ON. 


FIGURE  2.1-1  PILOT  OPINION  OF  THE  CONCEPT  OF  THE  UNIVERSALLY  ASSIGNABLE  PILOT 
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pilots  who  agreed  with  the  concept  are  also  shown. 

It  appears  to  us  that  many  of  the  pilots  who  said 
they  agreed  with  the  concept  probably  misunderstood 
the  question.  In  any  event,  there  appears  to  be 
absolutely  no  question  that  the  majority  of  the 
pilots  not  only  disagree,  but  are  actually  hostile 
to  the  concept.  The  specialized  literature  dealing 
with  this  subject  area  is  also  very  critical  of  the 
concept  of  the  universally  assignable  pilot.  The 
following  remarks  are  drawn  from  three  recent  Air 
University  research  reports. 

The  most  recent  of  these  studies  was  conducted 
by  Cooper,  Imaye,  Karre,  Robertson,  Ryan,  and 
Sakahara  (1976).  In  the  preface  to  their  study, 
these  authors  offer  a rather  succinct  condemnation 
of  the  concept  of  the  universally  assignable  pilot. 

"The  realities.  . .indicate  that  the  uni- 
versally assignable  concept  is  a myth.  It 
deserves  to  be  retired  to  its  niche  in 
military  history  along  with  the  battleship 
and  the  horse  calvary."  (p.  iii) 

Cooper,  et  (1976)  offered  several  reasons 
for  selection  and  specialization.  These  include 
the  training  costs  and  the  costs  of  accidents 
attributable  to  misassignment,  and  the  increased 
force  effectiveness  which  would  accrue  from  special- 
ized assignment.  Additionally,  the  current  tendency 
within  the  USAF  to  isolate  pilots  into  specific 
weapons  systems  (prompted  by  decreased  training 
costs  and  increased  proficiency)  attests  to  the 
need  for  specialization.  Underlying  all  of  these 
arguments  is  the  assumption  that  the  population 
of  potential  pilots  is  large  enough  to  permit 
proper  selection  and  that  valid  criteria  for  spec- 
ific pilot  jobs  can  be  developed  to  allow  this 
selection  process  to  take  place.  The  result  of 
this  effort  is  not  to  produce  a universal  pilot 
but  to  ".  . . place  the  pilot  candidate  in  the 
weapons  system  most  suited  to  his  particular  tal- 
ents, abilities,  and  motivations"  (Cooper,  et  al , 
1976,  p.  ii) 

Anderson  (1972)  in  his  Air  University  research 
report  entitled.  The  Tactical  Fighter  Pilot:  Improv- 
ing Combat  Effectiveness,  sums  up  the  great  need 
for  specialization. 


"In  order  to  obtain  the  first  great  need  of 
the  Air  Force,  that  is,  optimum  motivation, 
skill,  and  combat  capability  for  tactical 
fighter  forces,  tactical  fighter  pilot  train- 
ing must  be  reorientated  to  a dual  track  or 
specialized  system.  Prior  to  selection  for 
pilot  training,  individuals  should  be  identi- 
fied whose  physical  and  psychological  makeup, 
as  determined  by  the  appropriate  psychological 
testing,  indicates  potential  fighter  pilot 
capabilities.  Individuals  so  identified 
should  be  provided  specialized  training  ori- 
ented toward  eventual  fighter  pilot  qualifi- 
cation throughout  the  entire  undergraduate 
course  of  training."  (Anderson,  1972,  p.  36) 

In  an  Air  University  research  report,  Kyer 
(1973)  views  the  trend  towards  specialized  missions 
as  underlying  a trend  towards  specialization  of 
pilot  training.  To  quote  from  his  article: 


"The  Air  Force  has  recognized  that  tactical 
aircraft,  with  a specialized  mission,  are 
required  to  fill  a specific  tactical  require- 
ment. For  example,  the  A-7,  a conventional 
ground  support  type  aircraft  with  no  nuclear 
capability  and  limited  air-to-air  capability 
was  purchased.  The  first  air  superiority 
fighter  specifically  designed  for  the  air 
superiority  role  since  the  F-86,  the  F-15, 
was  initiated.  Requirements  for  a lightweight 
air  superiority  fighter  were  drafted  and  the 
A-7  and  A-10  prototypes  have  been  produced  to 
fill  the  necessity  of  a relatively  inexpensive 
ground  attack  aircraft.  With  the  change  in 
Air  Force  policy  from  the  multi-mission  air- 
craft to  the  specialized  aircraft,  will  Air 
Force  trainino  policy  also  change?  The  writer, 
[Kyer]  believes  that  a complete  change  in  air- 
crew selection  and  training  is  mandatory  in 
order  to  effectively  execute  the  Air  Force 
mission.  Only  those  aircrews  with  the  proper 
skills  and  aptitudes  should  be  selected  for 
air  superiority  training  programs."  (Kyer, 
1973,  PP.  12-13) 

To  summarize,  three  different  Air  University 
research  reports  that  recently  dealt  with  the  uni- 
versally assignable  pilot  have  for  a variety  of 
reasons  recommended  a return  to  specialized  pilot 
training.  These  arouments,  when  combined  with  the 
negativism  expressed  by  the  pilots  that  were  Ques- 
tioned concernina  the  concept  of  the  universally 
assignable  pilot,  stronaly  indicate  that  the  issue 
should  be  reviewed  at  the  highest  levels  of  U.S. 
military  decision  making. 
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2 . 2 SINGLE  VERSUS  MULTI-TRACK  TRAINING 

The  pilot  opinion  responses  conceminp  the 
relative  merits  of  sinole  versus  multi-track  train- 
ing are  shown  in  Figure  2.2-1.  Multi-track  training 
is,  of  course,  the  application  of  the  conceptual 
antithesis  of  the  universally  assignable  pilot.  As 
such,  we  expected  answers  which  would  mesh  with  the 
answers  to  the  universally  assignable  pilot  ques- 
tion. By  phrasing  the  present  question  with  the 
training  aspects  separated  from  the  operational 
implications  of  the  concept,  different  responses 
might  be  expected.  Fully  61%  of  the  pilots  strongly 
agreed  or  agreed  that  a multi-track  system  would  be 
superior  to  the  current  Air  Force  undergraduate 
pilot  training  single  track  approach.^  Twenty-one 
percent  of  the  pilots  disagreed  or  strongly  dis- 
agreed; 18%  had  no  opinion. 

QUESTION:  9- tilt 

WOULD  A MULTFTRACK  SELECTION  AND  TRAINING  PROGRAM  RESULT  IN 
BETTER,  AND  MORE  COMBAT  EFFECTIVE.  FIGHTER  PILOTS  THAN  THE 
PRESENT  SYSTEM  WHICH  GIVES  ALL  PILOTS  THE  SAME  UNDERGRADUATE 
TRAINING  (UNIVERSALLY  ASSIGNABLE  PILOT). 


FIGURE  2 PILOT  OPINION  CONCERNING  A MULTI- 
TRACK TRAINING  SYSTEM 


A large  amount  of  Air  Force  funded  work  was 
conducted  during  1969-70,  on  the  definition  of 
future  undergraduate  pilot  training.’  These  stud- 
ies were  comprehensive,  producing  a large  package 
of  documentation  addressing  the  many  critical 
issues  in  an  enterprise  designed  to  tailor  a pilot 
training  program  to  meet  the  operational  mission 
requirements  of  the  1975  to  1990  time  frame.  Sig- 
nificantly, each  of  the  contractors  recommended 
that  one  form  or  another  of  a multi  track  program 
be  instituted. 
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To  quote  from  the  Cooper,  ^ al^,  (1976)  sum- 
mary of  the  Northrop  Future  Undergraduate  Pilot 
Training  Study  (1971): 

"The  study  proposed  a primary  phase  followed 
by  one  of  three  different  basic  phases;  a 
generalized  basic  phase  much  like  the  present; 
a dual  track  basic  phase  of  fighter  and  bomber/ 
transport;  or  a faur  track  basic  phase  of  air 
superiority  fighter,  attack  fighter,  bomber, 
and  transport.  Of  primary  interest  is  the 
fact  that  the  assignment  problems  of  today  are 
going  to  remain  a major  factor  in  the  future. 
Should  one  of  the  track  systems  be  instituted, 
two  major  implications  are  evident.  The  selec- 
tion process  to  the  FAR  (Fighter/Attack/ 
Reconnaissance)  or  TTB  (Transports/Tanker/ 
Bomber)  track  will  have  to  be  made  even  earlier 
than  at  present;  and  to  make  a track  system 
both  effective  and  efficient,  the  selection 
process  must  be  more  accurate."  (p.59) 


Thus,  the  implementation  of  a multi-track  pro- 
gram returns  to  the  underlying  problem  of  effective, 
efficient  and  accurate  pilot  selection. 


2 . 3 DEDICATED  AND  CONTRACT  PILOTS 

One  approach  that  is  often  suggested  for  im- 
proving air-to-air  pilot  effectiveness  is  to  have 
certain  pilots  dedicated  specifically  to  that  mis- 
sion. Figure  2.3-1  shows  the  pilots'  attitudes 
regarding  this  concept.  Fully  72%  of  the  pilots 
agreed  or  strongly  agreed  that  air-to-air  pilots 
should  be  dedicated  specifically  to  that  mission; 

22%  disagreed  or  strongly  disagreed  with  the  con- 
cept. The  written  pilot  responses  shown  in  Figure 
2.3-1  characterize  the  pilots'  positive  and  negative 
attitudes  toward  this  concept. 


Less  than  50'’,  of  aJJ[  the  pilots  endorsed  (i.e., 
agreed  or  strongly  agreed)  the  concept  of  "the 
contract  pilot"  (see  Figure  2.3-1).  On  the  other 
hand,  64%  of  the  current  pilots  agreed  or  strongly 
agreed,  while  pointing  out  that  career  limitations 
were  improper. 


^The  sample  of  current  pilots  (i.e.,  excludino 
inputs  from  the  American  Fighter  Aces  Association) 
were  even  more  in  agreement;  79%  of  them  agreed  or 
strongly  agreed. 

’The  reader  can  find  the  bibliographical  refer- 
ences for  these  recent  studies,  along  with  a mimlier 
of  related  studies,  in  the  I ibliography  section  on 
Pilot  Training  Requirements  and  Techniques  ( >ee 
Section  9). 
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SELECTED  PILOT  RESPONSES  FRO*  »H0  AGREE  OR  STRORCLY  AGREE 


STATENENT: 

OUR  MOOERN  HIGH  PERFORIIANCE  AIR-TOJMR  COABAT  AIRCRAFT  SHOULD 
BE  PILOTED  BY  PILOTS  »H0  ARE  DEDICATED  TO  THAT  WSSIOR  lli.,  NO 
STAFF  ASSIGNMENTS). 


STRONGLY  AGREE 
AGREE 


DISAGREE  STRONGLY 
DISAGREE 


QUESTION; 

SUPPOSE  A SPECIAL  CATEGORY  OF  CAREER  AIR-TO-AIR  PILOT  MAS  DESIG- 
NATED. ONLY  HIGHLY  SELECTED  VOLUNTEERS  WOULD  BE  CHOSEN  ON  A 
CONTRACT  BASIS.  THEY  WOULD  RECEIVE  MORE  INTENSIVE  AIR-TO-AIR 
TRAINING,  WOULD  HAVE  HO  OTHER  DUTIES  AND  WOULD  RECEIVE  A NUMBER 
OF  SPECIAL  BENEFITS.  CAREER  ADVANCEMENT  WOULD,  HOWEVER,  BE 
LlfHITED.  WHAT  IS  YOUR  OPINION  OF  THIS  CONCEPT? 


DISAGREE 


STRONGLY  AGREE  NO  DISAGF 

AGREE  OPINION 

SELECTED,  PILOT  RESPONSES  FROM  MEN  WHO  DISAGREE  OR 
STRONGLY  DISAGREE 


STRONGLY 

DISAGREE 


DISAGREE 

AMERICAN 
FIGHTER  ACE 


DISAGREE 

RIVER  RAT 


DISAGREE 

AMERICAN 

FIGHTER  ACE 


-BELIEVE  THAT  AVERAGE  WELL-TRAINED  FIGHTER 
PILOT  IS  A GOOD  POTENTIAL  AIR-AIR  COMBAT 
CANDIDATE.  I VOTE  FOR  QUANTITY  AND  STAN- 
DARDIZATION. A CORPS  OF  “ELITE”  AIR-AIR 
PILOTS  WOULD  BE  A PAIH-IN-THE-ASS  TO  THE 
REMAINDER  OF  THE  FIGHTER  FORCE  AND 
PROBABLY  WOULD  DO  NO  BETTER  IN  COMBAT 
THAN  THEIR  LESS  “ELITE”  CONTEMPORARIES 
PROVIDED  EQUAL  OPPORTUNITIES  ARE  PRE- 
SENTED. 

-THOUGH  SPECIAL  CATEGORY,  THESE  SELECTED 
PILOTS  SHOULD  HAVE  OTHER  DUTIES  (COMPATIBLE 
WITH  FLYING  SIMULATOR  TRAINING)  AND  SHOULD 
HAVE  UNLIMITED  OPPORTUNITY  FOR  PROGRESSION. 

-I  DON'T  LIKE  IT.  A GOOD  FIGHTER  PILOT  SHOULD 
BE  (AND  THE  BEST  ONES  ARE)  WELL  ROUNDED  IN 
MILITARY  REQUIREMENTS  OTHER  THAN  A “FAST 
DRAW"  - A GOOD  FIGHTER  PILOT  WOULD  NOT 
ACCEPT  THESE  HARROW  LIMITATIONS  THAT  DENY 
A BROADER  KNOWLEDGE.  GREATER  UNDERSTAND- 
ING. THE  OPPORTUNITY  TO  GROW  - PRIDE  AND 
HEART  WOULD  BE  DOWNPLAYED. 


STRONGLY 

AGREE 

NAVY  MIG 
KILLER 

STRONGLY 

AGREE 

AGGRESSOR 

SQUADRON 

STRONGLY 

AGREE 

NAVY  MIG 
FIGHTER 

STRONGLY 

AGREE 

RIVER  RAT 

STRONGLY 

AGREE 

RIVER  RAT 

AGREE 

AIR  NATIONAL 
GUARD 

STRONGLY 

AGREE 

AMERICAN 
FIGHTER  ACE 


AGREE 

AMERICAN 
FIGHTER  ACE 

AGREE 

AMERICAN 
FIGHTER  ACE 


STRONGLY 

AGREE 

ACEVAL  - 
AIMVAL 


- absolutely  agree,  and  though  I 'M  NOW  31  AND  HAVE 
BEEN  OUT  OF  F-ts  FOR  FOUR  YEARS.  I'D  BE  THE  FIRST 
TO  SIGN  UP.»LET  ME  KNOW  - IT'S  A GREAT  CONCEPTS 


-IF  YOU'RE  SERIOUS  ABOUT  FLYING  AIR-T04IR  - 
ADVANCEMENT  BN'T  IMPORTANT. 


- SOME  OF  THE  BEST  FIGHTER  PILOTS  I KNOW  DON'T  CARE 
TO  BE  OF  FLAG  RANK  OR  CAPTAIN  - ALL  THEY  WANT  TO 
DO  IS  FLY.  WHEN  THEY  ARE  TOLD  THAT  THEY  MUST  DO  A 
SHIP'S  COMPANY  TOUR  FOR  THE  GOOD  OF  THEIR  CAREER, 
MANY  GET  OUT  - UKE  I DD. 

- I HAVE  SAID  THE  SAME  THING  MANY  TIMES.  I WOULD  BE 
MORE  THAN  HAPPY  TO  SPEND  20  YEARS  FLYING  FIGHTERS 
AND  NOT  EXPECT  TO  MAKE  RANK  HIGHER  THAN  0-3. 

-CAREER  ADVANCEMENT  SHOULD  NOT  BE  LIMITED  - IF 
ANYTHING.  THESE  INDIVIDUALS  SHOULD  BE  CONSIDERED 
AN  “tLlTE"  AND  PROMOTED  AHEAD  OF  THEIR  CONTEM- 
PORARIES. 

- 1 MILDLY  OBJECT  TO  THE  CONCEPT  OF  THE  EUTE  TRAINED 
PROFESSIONAL  KILLER  BUT  IT  WOULD  BE  DEADLY  EFFEC- 
TIVE IN  COMBAT. 

-IF  THE  ENEMY  HAS  A STRONG  AIR-T04IR  CAPABILITY 
THIS  IS  ESSENTIAL.  A SUPER  AIR-TO-AIR  CAPABILITY 
WOULD  BE  A BIG  DETERRENT  FOR  A POTENTIAL 
AGGRESSOR.  HE  WOULD  EITHER  HAVE  TO  DILUTE 
HIS  BOMBARDMENT  CAPABILITY  OR  ACCEPT  LARGER 
LOSSES.  WE  WOULD  GAIN  EITHER  WAY. 

- MANY  OF  YOUR  BEST  FIGHTER  PILOTS  (WORLD  WAR  II) 

WERE  HOT  CAREER  ORIENTED  PEOPLE. 

-I  HAVE  ALWAYS  FELT  WE  WOULD  HAVE  BEEN  AHEAD  IN 
A COMBAT  SITUATION,  WWI,  WWII  AND  KOREA,  HAD  WE 
CONCENTRATED  ON  PROFESSIONAL  PILOTS  RATHER  THAN 
OFFICERS.  WE  '.OST  A LOT  OF  GOOD  FIGHTER  PILOTS 
BECAUSE  THEY  WERE  NOT  GOOD  OFFICER  MATERIAL. 

-WE  HAVE  PROVEN  TIME  AND  TIME  AGAIN  THAT  A STAFF 
OFFICER  IS  NOT  A LINE  FIGHTER  PILOT  AND  CANNOT 

EVER  BE BUT  WHY  LIMIT  CAREER  ADVANCEMENT? 

THE  OPTIONS,  HOWEVER.  AS  SUGGESTED.  SHOULD  BE 
CLEAR,  WITH  NO  “HAZY"  CRITERIA  FOR  ADVANCED 
PROMOTION  AS  IS  NOW.  I BELIEVE  IN  AN  ELITE  CORPS 
- DEDICATED  WARRIORS  “PATTON”  AIR-TOJLIR  PILOT 
CADRE  IS  THE  ANSWER. 


FIGURE  2.H  PILOT  OPINION  CONCERNING  DEDICATING  PILOTS  TO  CERTAIN  MISSIONS  AND  TO  A SPECIAL 
CAREER  FIELD  OF  AIR-TO-AIR 
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The  explicit  statement  put  forward  in  our  ques- 
tion to  the  pilots  (see  Figure  2.3-1),  that  "career" 
limitations  would  be  part  of  a "dedicated"  pilot  pro- 
gram caused  considerable  pilot  response.  The  major- 
ity of  pilots  wrote  strong  responses  clearly  stating 
that  pilots  should  be  dedicated  to  a specific  career 
field,  but  that  this  should  not  limit  progression. 


The  Air  University  research  report  by  Anderson 
(1972),  mentioned  earl ier, ^also  has  high  relevance 
for  the  issue  of  improving  combat  effectiveness 
through  specialization  within  pilot  training,  as 
well  as  the  creation  of  a limited  fighter  pilot 
career  field.  The  following  quotes  are  taken  from 
Anderson  (1972). 

"[Another].  . . great  need  of  the  Air  Force  is 
to  create  an  environment  which  fosters  the  re- 
tention of  tactical  fighter  pilots  in  the  cock- 
pit for  the  entirety  of  their  career  in  the  Air 
Force.  The  dual  need  filled  by  pilot  training 
for  pilots  and  officers  will  continue  to  exist; 
however,  two  separate  career  options  must  be 
established  to  meet  this  need.  . . 

"A  'pilot  only'  career  pattern  must  be  estab- 
lished to.  . . 

‘Increase  utilization  of  pilot  skills  in 
active  flying  billets  during  the  (span  of 
the  specific  period).  . . (and)  will  offer 
advantages  of  increased  pilot  proficiency 
with  resultant  improvement  in  combat  readi- 
ness and  flight  safety.' 

"Current  and  past  dissatisfaction  with  the 
pilot  career  field  have  been  largely  due  to 
the  lack  of  a well  defined  career  pattern  for 
every  individual  entering  pilot  training. 

This  is  especially  true  when  junior  officers 
are  able  to  view  the  inconsistencies  of  a per- 
sonnel plan  which  must  rely  on  "surge"  and 
"drawdown"  rather  than  retention  to  fill  pilot 
vacancies  created  by  the  attrition  of  retire- 
ment and  combat  losses.  Pilots  returned  to 
the  cockpit  two  and  three  times  is  not  only 
demoralizing,  but  it  is  extremely  expensive. 
Replacing  the  current  system  in  which  the 
pilot  retention  rate  averages  46%  with  one  in 
which,  after  ten  years  the  average  retention 
rate  is  73%  would,  according  to  the  Logistics 
Management  Institute,  result  in  a differential 
cost  of  $217  million  per  year.  The  73%  reten- 
tion rate  at  10  years  closely  approximates  the 
value  which  could  be  expected  from  a pilot 
only  fixed  career  pattern."  (Anderson,  1972, 
pp.  37-39) 
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Not  surprisingly,  an  overwhelmingly  89%  of  all 
the  pilots  agreed  or  strongly  agreed  with  the  word- 
ing of  our  question  concerning  adequate  training  for 
combat  readiness. '*  The  histogram  in  Figure  2.4-1 
shows  a breakdown  of  pilot  opinion. 

No  written  responses  were  requested  for  this 
particular  question.  However,  we  did  ask  the  pi- 
lots what  they  thought  the  principal  benefits  and 
limitations  of  air  combat  maneuvering  training  were. 
Their  selected  responses  are  also  shown  in  Figure 
2.4-1.  The  comtnents  made  it  quite  clear  that  the 
pilots  thiik  there  are  tremendous  benefits  associ- 
ated with  air  combat  maneuvering  range  training. 

On  the  other  hand,  they  do  emphasize  the  absence 
of  certain  important  elements  of  actual  combat.^ 

The  question  of  whether  or  not  the  air  combat  maneu- 
vering ranges  offer  authentic  test  beds  for 
"predicting"  to  combat  is  considered  in  Section  2.9. 

2 . 5 PILOT  OPINION  CONCERNING  FORCE  STRUCTURE 

The  military,  in  general,  is  faced  with  steeply 
escalated  manpower  costs,  inflation,  and  the  contin- 
uing presence  of  real  and  threatened  budget  cuts. 

In  light  of  this,  we  sought  out  pilot  opinion 
to  the  following  question,  "Our  current  military 
budget  is  causing  severe  cuts  in  proficiency  train- 
ing. These  budget  cuts  can  be  made  a number  of 
ways.  In  your  opinion,  would  it  be  better  to, 

(1)  have  fewer  pilots  trained  to  top  effectiveness. 


''Readiness  issues  involving  an  entire  combat 
system  are  beyond  the  scope  of  this  study  but  a 
subject,  of  course,  of  considerable  interest. 
Illustrative  studies  of  naval  air  combat  readiness 
(Boissenin,  1966;  Dunn,  1964;  Feare,  1963;  and 
Whelchel,  1965),  Army  air  mobility  performance 
(Alluisi,  1964),  and  Air  Force  readiness  (Opera- 
tional Readiness  criteria  for  tactical  forces, 
1975)  are  identified  in  the  Reference  section  of 
this  document. 

^These  issues  are  treated  in  more  depth  in 
Section  6.2.3  which  deals  with  the  utilization  of 
air  combat  maneuvering  ranges  as  potential  "test- 
beds" in  an  improved  pilot  selection  program. 
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PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


IMCOOMMCLL.  DOUCI.AS 


STATEMENT: 

OUR  MODERN  HIGH  PERFORMANCE  AIR-TO-AIR  COMBAT  AIRCRAFT  SHOULD 
BE  PILDTED  BY  PILDTS  WHD  RECEIVE  ADEQUATE  TRAINING  SDRTIES  TD 
MAKE  THEM  CDMBAT  READY  AT  ALL  TIMES. 


QUESTIDN; 

WHAT  DD  YDU  THINK  ARE  THE  PRINCIPAL  BENEFITS  AND  UMITATIONS 
OF  ACMR  TRAINING? 


'ELECTED  PILOT  RESPONSES  ON  ACMR,/|  AS  A TRAINING  DEVICE: 

WITHOUT  THE  THREAT  OF  IMMINENT  DEATH,  YOU’LL  NEVER  EVER  BE  SURE, 
BUT  ACMI  COMES  AS  CLOSE  (ALONG  WITH  RED  FLAG  EXERCISES)  IN  PUHING 
PRESSURE  ON  EACH  PILOT  TO  SCORE  WELL,  AND  CLEARLY  DOCUMENTS  HIS 
HEAD. NANO  WORK. 


THE  BENEFITS  ARE  GREATLY  MAGNIFIED  IN  TODAY’S  COMBAT,  AS  MORE 
AND  MORE  IT  IS  A DUEL  BETWEEN  SOPHISTICATED  EQUIPMENT,  AND  THE 
BETTER  TRAINED  A PILOT  IS  IN  MAXIMIZING  HIS  ELECTRONIC  EQUIPMENT, 
THE  BETTER  CHANCE  HE  HAS  TO  WIN.  BUT  A MENTAL  ALERTNESS  AND 
COMPETITIVENESS  MUST  BE  THERE  TO  OPERATE  THE  GEAR  PROVIDED 
AND  TO  MAKE  A KILL  AND  SURVIVE. 

FROM  WHAT  I KNOW  OF  IT,  I THINK  IT  IS  THE  BEST  THING  SINCE  THE  JET 
ENGINE  - IF  PROPERLY  UNDERSTOOD  AND  USED  BY  THE  COMMANDERS 
INVOLVED. 

NO  B.S.  AS  TO  WHO  SHOT  WHO,  WHO  WAS  ACTUALLY  IN  FIRING  ENVELOPE, 
ETC.  WHAT  TACTICS  EMPLOYED. 


9 1114 

MISTAKES  ARE  OBVIOUS  AND  CAN  BE  STUDIED  IN  DEPTH  WHICH  PRECLUDES 
PILOT  MISTAKES  OVER  AND  OVER  WITHOUT  KNOWING  WHY  - S SAVINGS  LONG 
TERM. 

IT  IS  A TRAINING  TOOL.  IT  DOES  NOT  OBVIATE  THE  NEED  OF  A GIFTED 
INSTRUCTOR  TO  ANALYZE  THE  FIGHT  IN  THE  AIR  WITH  ACMR  AS  AN  AID  - 
DON’T  FORGET  THIS!  ITS  UMITATIONS  TECHNICALLY  ARE  FEW. 

IT  TEACHES  A PILOT  HOW  TO  MANEUVER  HIS  AIRCRAFT  INTO  POSITION 
TO  KILL.  IT  Also  GIVES  A PILOT  THE  REAL  FEEL  OF  HIS  AIRCRAFT  AND 
HOW  IT  IS  TO  HANDLE  IT. 

BENEFITS:  SEE  YOUR  ERRORS  PRESENTED  IN  REAL  TIME.  PERMITS 
ANALYSIS  OF  YOUR  MENTAL  CONCEPT  OF  THE  ENGAGEMENT  AS  IT 
NAS  OCCURRING. 

LIMITATIONS:  TRYING  TO  BEAT  THE  SYSTEMS  “GAMESMANSHIP" 

MAY  CREATE  BAD  HABITS  THAT  WOULD  GET  YOU  KILLED  IN  THE 
REAL  WORLD. 

BENEFITS:  LEARNING  HOW  TO  HANDLE  THE  A/C  TO  ITS  MAXIMUM 
POTENTIAL  AND  LEARNING  HOW  TO  MANEUVER  INTO  AN  AHACK 
POSITION. 

LIMITATIONS:  NO  ELEMENT  OF  FEAR  IF  YOU  LOSE  AND  ONLY  A 
SELF  SATISFACTION  IF  YOU  WIN.  (WHILE  THE  DESIRE  TO  WIN  IS 
USUALLY  SUFFICIENT,  DEATH  MAKES  LOSING  COMPLETELY  UN- 
ACCEPTABLE). 

GIVES  A PARTICIPANT  A CHANCE  TO  FLY  AGAINST  UNLIKE  AIRCARFT  AND 
A MEANS  VO  BEHER  ANALYZE  WHAT  HE  DIO  RIGHT  AND  WRONG  DURING 
AN  ENGAGEMENT.  LIMITATIONS  ARE  THOSE  NECESSARY  TO  ASSURE 
FLIGHT  SAFETY  AND  FAIRLY  RIGID  SCENARIOS. 

I BELIEVE  ANY  ACMR  EXPERIENCE  IS  BENEFICIAL  BUT  THAT  IT  CANNOT 
SIMULATE  EVERY  SITUATION  THAT  WILL  BE  MET  IN  AIR-TO-AIR  COMBAT. 
BELIEVE  THAT  ACMR  IS  A GOOD  INDICATOR  OF  WHAT  COULD  BE  EXPECTED 
OF  A PILOT  WHEN  THE  CHIPS  ARE  DOWN. 


IT  PROVIDED  THE  MOST  REALISTIC  TRAINING  I HAVE  EVER  EX- 
PERIENCED OUTSIDE  OF  SEA.  I WOULD  THINK  THIS  PRIMARY 
LNITATION  IS  FINANCIAL.  THE  EQUIPMENT  IS  EXPENSIVE 
AND  WOULD  NOT  BE  AVAILABLE  TO  ALL  UNITS  ON  A REGULAR 
BASIS.  I THINK  THE  AGGRESSOR  PROGRAM  IS  AN  EXCELLENT 
SECOND  CHOICE. 

BENEFITS:  ARE  THAT  EVERY  SHOT  IS  ANALYZED  AND  PILOTS 
GET  VALUABLE  EXPERIENCE  IN  ESTIMATING  WHICH  ARE  GOOD 
SHOOTING  POSITIONS  AND  WHICH  ARE  NOT.  RANGE  ESTIMATION 
AND  VERIFICATION  ARE  ALL  IMPORTANT. 

LIMITATIONS:  YOU  CANNOT  ACTUALLY  SHOOT  DOWN  AIRPLANES; 
YOUR  ALTITUDE  MIN  IS  FIXED  - THERE  ARE  CERTAIN  ARTIFACTS 
GUILT  INTO  A TRAINING  ENVIRONMENT  BY  NECESSITY. 


FIGURE  Z.4-1  PILOT  OPINION  CONCERNING  TRAINING  FOR  COMBAT  READINESS  AND  THE  VALUE  OF  AIR  COMBAT 
MANEUVERING  RANGE  TRAINING 
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(2)  have  a full  complement  of  pilots  trained  as 
well  as  you  can  within  the  assigned  budget,  (3) 
have  a mix  of  pilots  some  at  full  and  some  at 
partial  efficiency?" 

Pilot  responses  to  this  question  are  shown  in 
Figure  2.5-1.  One-third  of  the  pilots  thought  that 

*-IM3 

QUESTION: 

OUR  CURRENT  MILITARY  BUOGET  IS  CAUSING  SEVERE  CUTS  IN  PROFICIENCY 
TRAINING.  THESE  BUOGET  CUTS  CAN  BE  MAOE  IN  A NUMBER  OF  WAYS.  IN 
YOUR  OPINION  WOULD  IT  BE  BETTER  TO;  (CHECK  ONE) 

(1)  HAVE  FEWER  PILOTS  TRAINED  TO  TOP  EFFECTIVENESS.  334 

(2)  HAVE  A FULL  COMPLEMENT  OF  PILOTS  TRAINED  AS 

WELL  AS  YOU  CAN  WITHIN  THE  ASSIGNED  BUDGET.  26*. 

(3)  HAVE  A MIX  OF  PILOTS  SOME  AT  FULL  AND  SOME  AT  41% 

PARTIAL  EFFICIENCY. 

FIGURE  2.5-1  PILOT  OPINION  CONCERNING  PILOT 
FORCE  TRAINING  IN  THE  FACE  OF  BUOGET  REALITIES 


it  would  be  best  to  have  fewer  pilots  trained  to 
top  effectiveness.  Over  a third  of  the  pilots  felt 
that  a mix  of  pilots,  some  at  full  and  some  at 
partial  efficiency,  would  be  the  preferred  approach. 
Twenty-six  percent  of  the  pilots  felt  that  it  would 
be  best  to  dilute  pilot  proficiency  across  the  Air 
Force  and  have  a full  complement  of  pilots  trained 
as  well  as  oossiole  within  the  assioned  budget. 

Pilot  training  philosophy  mix  is  but  one  aspect 
of,  or  solution  to,  the  more  global  problem  facing 
the  military  at  this  time.  Overall  budgetary  con- 
siderations have  forced  a substantial  reduction  in 
the  size  of  the  pilot  force  that  can  be  maintained 
by  the  military.  The  services,  therefore,  are  con- 
fronted with  the  problem  of  maintaining  readiness 
and  combat  effectiveness  during  a period  when  fewer 
pilots  are  available. 

While  part  of  the  larger  overall  issue  of  man- 
power planning'll  one  of  the  areas  where  the  appli- 
cation of  selection  techniques  can  materially  im- 
pact force  readiness  is  in  the  area  of  selecting 
for  combat  effective  pilot  qualities  as  well  as 
selecticn  for  the  aviator’s  probability  of  staying 


within  the  force  structure,  i.e.,  retention  in  the 
military. 

Understandably,  each  of  the  services  has  stud- 
ied the  factors  associated  with  the  retention  of 
aviators  as  well  as  other  career  fields.  For 
example,  research  on  a group  of  U.S.  Army  aviation 
warrant  officers,  of  which  only  25%  continued  beyond 
their  obligated  period,  has  shown  that  responses  to 
a "career  intention"  questionnaire  are  an  accurate 
predictor  of  retention  and  nonretention,  partic- 
ularly for  the  departing  group  (Boyd  and  Boyles, 
1968;  Boyd  and  Boyles,  1969).  Some  of  the  factors 
influencing  the  retention  of  Marine  Corps  officers 
(Klingerman,  1970)  and  Naval  aviators  (Howard,  1965; 
Nelson,  1958)  have  been  studied.  From  our  liter- 
ature search,  however,  it  appears  that  the  Air  Force 
has  conducted  the  most  research  in  this  area. 
Calclasure  (1971), under  Air  Force  sponsorship,  has 
produced  a comprehensive  review  of  the  literature 
dealing  with  career  motivational  predictions  and 
selection  procedures.  The  Human  Resources  Research 
Organization  (HumRRO),  under  contract  to  the  Air 
Force  Human  Resources  Laboratory  (AFHRL),  has  pro- 
duced a comprehensive  analysis  of  the  classifica- 
tion, assignment  and  separation  systems  of  the  Air 
Force,  Army,  Marine  Corps, and  Navy  (Harding  and 
Richards,  1971).  Alvord  and  Ewing  (1964)  have 
reported  upon  the  Air  Force's  "Project  M"  which 
traced  the  retention  of  72,000  officers  entering 
the  Air  Force  from  1955  through  1962.  Retention 
rates  are  reported  by  year  of  entry,  procurement 
source,  flying  status,  education,  age.  Air  Force 
Officer  Qualifying  Test  (AFOQT)  score,  and  by 
career-field  assignment.  Additional  Air  Force 
sponsored  research  has  shown  a relationship  between 
retention  and  various  demographic  and  attitudinal 


^Both  the  Air  Force  (e.g.,  Kildebeck,  ejt  aX, 

1969;  Kipnes,  1970)  and  the  Navy  (e.g.,  Taylor  and 
Arzigian,  1970)  have  developed  mathematical  man- 
power "models"  which  permit  planners  to  ask,  "What 
if"  questions  involving  the  prediction  of  pilot 
training  requirements.  One  model  (Kildebeck,  et  XL* 
1969),  for  example,  can  predict  the  number  of  ^lots 
by  aircraft  type  that  would  be  required  for  the 
successful  military  conduct  of  any  given  (hypothe- 
sized) scenario. 
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factors  (Ewing,  1967;  Shenk,  1969)  as  well  as  type 
of  college  attended  and  type  of  degree  awarded 
(Ewing,  1965;  Tupes  and  Madden,  1968). 

While  wf  will  not  review  these  studies  in 
detail  within  this  context,  it  should  be  pointed 
out  that  they  do  form  an  excellent  empirical  data 
base  on  which  to  build  an  officer  "selection-for- 
retention"  program.  While  the  degree  of  relation- 
ship between  the  predictor  variables  and  the  reten- 
tion of  the  officer  in  the  military  is,  in  all 
probability,  not  strong  enough  to  be  used  across 
the  entire  entering  officer  corps  in  general,  they 
are  of  sufficient  goodness  that  a program  could  be 
developed  for  high  retention  for  selected  career 
fields,  such  as  air-to-air  fighter  pilots. 

While  the  main  thrust  of  our  effort  in  this 
study  will  be  the  development  of  a technique  to 
select  for  air-to-air  combat  effectiveness,  there 
appears  to  be  no  technical  reason  why  selection- 
for-career-retention  could  not  be  included  within 
a larger  selection-for-combat-effectiveness 
selection  program.  If  that  were  to  be  the  case, 
however,  a more  detailed  reexamination  of  the  re- 
tention data  which  we  have  alluded  to  here  would 
have  to  be  undertaken  and  integrated  into  the  over- 
all combat  effectiveness  selection  program. 

Two  recent  Air  University  research  reports 
have  treated  the  issue  of  retention  in  the  military 
and  cockpit  (Karalus,  1970;  Anderson,  1972). 

Karalus  (1970)  begins  his  argument  by  quoting  from 
the  then  new  "officer  personnel  objective  structure 
(Topi ine) . " 

"The  Air  Force  is  short  of  pi lots... the  magni- 
tude of  this  shortage  is  5500... the  trend  indi- 
cates that  pilot  production  will  not  equal 
pilot  losses  through  1974... there  is  little 
doubt  that  the  Air  Force  will  begin  the  next 
major  contingency  with  the  pilot  force  of  far 
less  size  than  which  it  began  in  Viet  Nam..." 
(p.  2). 

Karalus  then  focuses  on  one  very  obvious  area 
where  retention  rates  for  Air  Force  aviators  might 
be  improved,  and  that  is  by  looking  at  the  predic- 
tor variable  of  input  source.  The  data  shown  in 
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Figure  2.5-2  has  been  adapted  from  Karalus'  report, 
and  by  inspection  it  can  be  seen  that  by  using  the 
predictor  of  input  source  alone,  that  a substantial 
improvement  in  retention  could  be  made  if  Air  Force 
policy  were  modified  so  that  only  high  retention^ 
groups  were  considered  for  pilot  training.  We  show 
the  above  data  as  illustrative  only;  we  are  making 
no  strong  recommendation  that  such  a policy  change 
be  implemented  by  itself.  Rather,  the  data  show 
that  there  are  dramatic  differences  in  attrition 
rates  as  a function  of  input  source.  Similar  kinds 
of  p.redictors  of  retention  in  a particular  career 
specialty  (in  this  case,  pilots)  could,  we  think, 
be  developed  from  the  substantial  data  base  which 
we  find  in  the  literature.  These  could  be  included 
in  an  overall  selection  program  developed  to  produce 
combat  effective  air-to-air  pilots. 
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ACTIVE  AIR  FORCE  SOURCE 

PERCENT 

ENTERING 

PERCENT 
ATTRITION 
(ALL  CAUSES) 

OTS  (OFFICER  TRAINING  SCHOOL)  COLLEGE  GRADUATES 

34 

ROTC  (RESERVE  OFFICER  TRAINING  CORPS) 

27 

22 

AFA  (AIR  FORCE  ACADEMY) 

9 

12 

RATED  (AIR  FORCE  OFFICERS)  (NAVIGATORS) 

1 

7 

NONRATED  AIR  FORCE  OFFICERS 
OTHER: 

6 

34 

MARINE 

4 

12 

ANG  (AIR  NATIONAL  GUARD) 

4 

22 

FOREIGN 

3 

23 

FIGURE  2.5-2  ATTRITION  RATES  OF  UPT  STUDENTS 
AS  A FUNCTION  OF  ENTRY  SOURCE  (FY  1969) 


2 . 6 PILOT  OPINION  ON  THE  EFFECT  OF  OUT-OF-COCKPIT 
ASSIGNMENTS  ON  PILOT  COMBAT  FLYING  SKILLS 

This  section  assesses  pilot  opinion  concerning 
the  effect  of  various  out-of-cockpit  assignments 
upon  air-to-air  combat  effectiveness.  To  that  end 
we  asked  the  various  questions  shown  in  Figure 
2.6-1. 


^Technically,  the  author  is  talking  about  attri- 
tion in  pilot  training,  yet  his  point  is  a good  one. 
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STATEMENT; 

A SUBSTANTIAL  NUMBER  OF  PILOTS  ARE  OFFERED  CAREER  BROADENING 
OPPORTUNITIES  EARLY  IN  THEIR  FLYING  CAREER.  THESE  JOBS  ARE 
GENERALLY  NON-FLYING  MANAGEMENT  POSITIONS.  SUCH  ASSIGNMENTS, 
NHILE  IMPORTANT  TO  CAREER  DEVELOPMENT,  BREAK  THE  CONTINUITY 
OF  DEVELOPMENT  OF  THE  PILOTS'  COMBAT  FLYING  SKILLS. 

QUESTION; 

HON  MUCH  DO  YOU  THINK  THIS  DISCONTINUITY  NILL  AFFECT  THE  LATER 
AIR-TO-AIR  COMBAT  EFFECTIVENESS  OF  THESE  PILOTS? 


PERCENT 
OF  20 
PILOTS 


VERY  SOME  VERY  NOT 
MUCH  LITTLE  AT  ALL 

SELECTED  PILOT  COMMENTS  REGARDING  THIS  QUESTION; 


VERY  MUCH 

AIR  NATIONAL 
GUARD 


VERY  LITTLE 

AMERICAN 
FIGHTER  ACE 


- 1 HAVE  PERSONAL  EXPERIENCE  IN  THIS  AREA  HAVING 
BEEN  FORCED  INTO  A NON-FLYING  POSITION  FOR  3fi 
YEARS.  IT  HAS  BEEN  EXTREMELY  DIFFICULT  TO  REGAIN 
MY  FORMER  LEVEL  OF  COMPETENCE;  I RETURNED  TO 
FLYING  A YEAR  AGO  AND  AM  STILL  NOT  SATISFIED  WITH 
MY  LEVEL  OF  PROFICIENCYAACTICAL  ABILITY. 

I’M  WILLING  TO  BET  THAT  9«  OF  THE  WWII  ACES  HOW 
LIVING  COULD  HACK  THE  SAME  PROBLEM  WITH  A MONTH 
OR  TWO  REFRESHER  IN  THE  SAME  AIRCRAFT  THEY  FLEW 
AND  WITH  THE  SAME  WEAPONS  SYSTEM,  HEALTH  PER- 
MITTING. I THINK  IT  STAYS  WITH  YOU  AS  AH  ATTRIBUTE. 
BUT  I DO  SENSE  WE'RE  REALLY  CONCERNED  WITH  TWO 
KINDS  OF  AIR-TO-AIR  COMBAT  TODAY;  1)  GUNS  AND 
SHDRT  RANGE  ROCKETS  AND  2)  LONG  RANGE  ROCKETS 
(S  MILES  TO  IS  MILES)  WHERE  IT'S  ME  AND  MY  RADAR- 
SCOPE  AGAINST  A BLIP. 


QUESTION; 

ASSUMING  THAT  YOU  WOULD  EVENTUALLY  BE  REASSIGNED  TO  AH  AIR-TO- 
AIR  COMBAT  ROLE,  HOW  LONG  WOULD  YOU  BE  WILLING  TO  BE  OUT  OF  THE 
COCKPIT  FOR  ANOTHER  TYPE  OF  ASSIGNMENT? 

SELECTED  PILOT  COMMENTS  REGARDING  THIS  QUESTION; 


VERY  MUCH  - 

RIVER  RAT 


VERY  MUCH 

AMERICAN 
FIGHTER  ACE 


SOME 

AMERICAN 
FIGHTER  ACE 


• I DON’T  THINK  ANY  PILOT  SHOULD  EVER  BE  "OUT 
OF  THE  COCKPIT."  IN  OTHER  WORDS,  TO  BE  CON- 
SBTENT  ABOUT  THE  FIRST  PART  OF  THE  SLOGAN; 
"OUR  BUSINESS  IS  TO  FLY  AND  TO  FIGHT,"  WE  HAVE 
TO  OBEY  THE  SECOND  PART;  “DON'T  YOU  tVtH  FOR 
GET  IT."  I AM  DOGMATICALLY  OPPOSED  TO  THE 
PRESENT  “BUDGET"-MOTIVATEO  DEVELOPMENT 
WHICH  HAS  ELIMINATED  CRT.  SOME  KIND  OF  FLYING 
IS  MANDATORY  FOR  RATED  OFFICERS  ON  FIGHT 
FLIGHT-RELATED  STAFF  ASSIGNMENTS. 

- PILOTS  ARE  MOST  EAGER  AND  LEARN  MOST  IN  THE 
EARLY  YEARS  OUT  OF  FLYING  SCHOOL.  THESE 
SHOULD  BE  THE  YEARS  OF  INTENSIVE  FLYING 
TRAINING  WITH  MANAGEMENT  TRAINING  SECONDARY. 
AFTER  THE  PILOT  HAS  MASTERED  THE  ART  THEN 
MANAGEMENT  DUTIES  CAN  BE  ASSUMED  DN  AN  IN- 
CREASING BASIS. 

- AFTER  ABOUT  AGE  35  YEARS,  I BELIEVE  PHYSICALLY 
AND  MENTALLY,  A FIGHTER  RLOT  WILL  BE  "BURNT 
OUT."  THE  BEST  YEARS  FOR  TOP  PROFICIENCY  ARE 
THE  20$. 


FIGURE  2.6-1  PILOT  OPINION  ON  THE  EFFECT  OF  OUT-OF-COCKPIT  ASSIGNMENTS  ON  PILOT  COMBAT  FLYING  SKILLS 


In  response  to  the  question,  "How  much  do  you 
think  discontinuities  will  affect  the  later  air-to- 
air  combat  effectiveness  of  these  pilots?",  forty 
percent  thought  that  such  assignments  would  "very 
much"  affect  later  combat  effectiveness.  Thirty- 
nine  percent  of  the  pilots  thought  that  there 
would  be  some  effect.  Twenty-one  percent 
of  the  pilots  felt  that  there  would  be  very  little 
or  no  effect  at  all.  Representative  written 
responses  reflecting  both  ends  of  the  spectrum  are 
also  presented  in  Figure  2.6-1. 


Responses  are  also  given  typifying  the  replies 
to  the  following  question,  "Assuming  that  you  would 
eventually  be  assigned  to  an  air-to-air  combat  role, 
how  long  would  you  be  willing  to  be  out  of  the  cock- 
pit for  another  type  of  assignment?"  The  most  fre- 
quent duration  that  pilots  reported  they  would  be 
"willing  to  be  out  of  the  cockpit"  was  three  to  six 
months.  Many  pilots  were  rather  adamant  about 
spending  any  time  out  of  the  cockpit. 

Out-of-cockpit  pilot  assignments  are  used  for 
a number  of  purposes  within  military  aviation,  but 
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generally  all  under  the  aegis  of  the  career  officer 
broadening  his  career  base  in  preparation  for  more 
senior  managerial  assignments.  The  positive  aspects 
of  this  policy  will  not  be  described  here.  However, 
three  frequently  referred  to  negative  aspects  of 
taking  the  pilot  out  of  the  cockpit  will  be  dis- 
cussed. They  are  (1)  reduction  in  effectiveness  as 
a result  of  cumulative  lack  of  experience,  (2)  the 
increase  in  accidents  as  cockpit  time  is  decreased, 
and  (3)  the  issue  of  currency  or  readiness. 

The  role  of  total  cockpit  experience  time  as 
it  relates  to  operational  effectiveness  will  be 
developed  in  detail  in  Section  3.1.  We  wiU  find 
that  experience  was  positively  correlated  with  com- 
bat kills,  both  in  Korea  and  Southeast  Asia. 

Anderson  (1972)  and  Cooper,  et  al^,  (1976)  have 
reviewed  aviation  accidents  with  respect  to  cockpit 
experience  from  two  slightly  different  perspec- 


“These  two  studies,  taken  together,  suggest 
that  a policy  which  retains  pilots  in  aircraft 
of  similar  performance  and  mission  for  ex- 
tended periods  of  time,  would  be  advantageous 
from  the  point  of  view  of  increasing  combat 
effectiveness  and  reducing  pilot  error  acci- 
dent potential.  . . With  regard  to  perform- 
ance, data  gathered  from  gunnery  and  dive- 
bombing  meets  suggest  that  fighter  pilot  cap- 
abilities are  directly  correlated  with  experi- 
ence measured  in  hours.  Analysis  of  one 
command-wide  gunnery  meet  pointed  out  impor- 
tant differences  in  dive-bombing  accuracy  on 
both  sides  of  1500  hours  of  flying  experi- 
ence. . . The  results  of  this  analysis  showed 
that  the  probable  circular  error  (CEP)  for 
pilots  with  greater  than  1500  hours  was  54 
feet  smaller  than  that  of  pilots  with  less 
than  1500  hours."  (Anderson,  1972,  pp.  28-30) 

Taken  together,  these  isolated  instances  form 
a pattern  which  argues  strongly  for  the  importance 
of  aae,  and  flying  experience  and  perhaps  even  more 
strongly  for  continuity  of  aircraft  background  in 
attaining  maximum  fighter  pilot  combat  capability. 


To  quote  from  Cooper,  et  al,  1976: 


To  quote  from  Anderson  (1972): 


"In  addition  to  improved  combat  effectiveness, 
increased  flying  experience  and  pilot  age  are 
significant  factors  which  are  directly  related 
to  decreasing  aircraft  accidents.  An  analysis 
of  pilot  error  accidents  in  a group  of  16  F-86 
pilots,  after  completing  upgrading  training  in 
an  operational  training  unit,  revealed  that, 
those  pilots  who  were  in  the  middle-aged  group, 
with  a median  age  of  27  years,  who  had  jet  air- 
craft background  were  more  proficient  and  had 
a lower  accident  potential  than  either  recent 
graduates  of  pilot  training  (median  age  of  21), 
or  older  pilots,  median  age  of  39,  who  nao  no 
jet  aircraft  background. 

"The  USAF  Sabre  Wings  Study  of  Pilot  Profi- 
ciency (USAF  Tactical  Air  Weapons  Center, 

1973a,  1973b,  1974a,  1974b)  points  out  the 
following: 

'Analysis  of  F-4  Combat  Crew  Training 
Schools  performance  scores  of  pilots  with 
background  in  like  aircraft  to  those  pilots 
with  unlike  backgrounds  as  a function  of 
age  indicated  that  age  and  aircraft  back- 
ground were  significant  variables  in  deter- 
mining pilot  performance.  Pilots  with  like 
backgrounds  did  significantly  better  than 
pilots  with  unlike  backgrounds.  Addition- 
ally, age  was  a significant  factor  for 
pilots  with  unlike  aircraft  backgrounds. 
Pilots  less  than  37  years  performed  sig- 
nificantly better  than  those  37  and  over. 
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"In  1974  alone,  USAF  flight  accidents  cost  98 
lives  and  more  than  $250  million  in  equipment. 

. . [Accident  trend  analysis  has  shown  that] 

FAR  aircraft  have  a higher  accident  rate  than 
do  TTB  aircraft.  During  the  early  1960's  the 
FAR  accident  rate  was  approximately  five  times 
that  of  the  TTB  rate.  More  recently,  the  FAR 
accident  rate  has  been  two  to  three  times 
greater.  . . [see  Figure  2.6-2] 

"Variation  in  missions  between  the  FAR  and  TTB 
roles  probably  accounts  for  the  variation  in 
accident  rates.  The  FAR  mission  routinely 
places  the  pilot  in  an  error-sensitive  environ- 
ment where  inattention,  distraction,  or  minor 
misjudgments  could  readily  cause  an  accident. 

. . Repeated  flight  into  error-sensitive  en- 
vironments should  lead  to  higher  occurrences 
of  pilot  error  accidents.  Historically,  that 
has  been  the  case.  The  percentage  of  acci- 
dents attributed  to  pilot  error  is  higher  for 
FAR  aircraft  than  for  TTB  aircraft  [see  Figure 
2.6.3]."  (Cooper,  et  1976.  pp.  19-21) 


’'Aviation  accident  research  constitutes  a rather 
large  literature.  A substantial  number  of  refer- 
ences are  provided  the  interested  reader  in  our 
bibliography  (see  Section  9). 
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YEAR 

FIGHTER^ 

ATTACK* 

TRANSPORT^ 

BOMBER 

I960 

222 

1.7 

3.8 

1961 

242 

1.7 

32 

1962 

24.0 

3.3 

6.9 

1963 

18.1 

1.5 

2.0 

1964 

17.6 

9.7 

1.8 

4.5 

1970 

9.7 

10.3 

1.5 

4.8 

1971 

8.5 

8.6 

1.2 

3.7 

1972 

9.0 

11.6 

1.5 

5.5 

1973 

9.5 

102 

12 

42 

1974 

7.8 

7.5 

1.5 

5.2 

ACCIDENT  RATES  00  NOT  INCLUDE  LOSSES  DUE  TO  COMBAT  IN  SOUTHEAST 
ASIA. 

'from  1960-1963  NO  DISTINCTION  WAS  MADE  BETWEEN  FIGHTER  AND 
ATTACK. 

^TANKER  AIRCRAFT  ACCIDENTS  ARE  INCLUDED  IN  TRANSPORT  RATES. 
^RECCE  AIRCRAFT  ACCIDENTS  ARE  INCLUDED  IN  FIGHTER  ACCIDENT 
RATES. 

FIGURE  2.6-2  AIRCRAFT  ACCIDENT  RATE  PER  100,000 
FLYING  HOURS  (Compiled  from  USAF  Accident  Bulletins 
1960-1974,  1970-1974). 


9-1118 


FIGHTER 

ATTACK 

TRANSPORT 

BOMBER 

TOTALS 

296 

37 

104 

49 

PILOT  ERRORS 

81 

11 

21 

8 

27% 

30% 

20% 

16% 

FIGURE  2.6-3  ACCIDENTS  ATTRIBUTED  TO  PILOT  ERROR 
1970-1972  DUE  TO  INCORRECT  OPERATION  OF  AIRCRAFT 
SYSTEMS;  POOR  TECHNIQUE  IN  FLIGHT,  POOR  TECH- 
NIQUE IN  PATTERN  (Compiled  from  USAF  Accident  Bulletins, 
1970-1972) 

The  out-of-cockpit  effect  on  pilot  readiness 
has  receiiciy  been  reviewed  by  Prophet  (1976a). 

This  study,  conducted  in  support  of  the  USAF  Sabre 
Wings  II  Study,  reviews  the  literature  concerning 
the  long  term  retention  of  flying  skills. 

Prophet's  review  is  supplemented  by  an  annotated 
bibliography  (Prophet,  1976b).  The  review,  con- 
ducted for  the  Air  Force  Assistant  Chief  of  Staff 
for  studies  and  analysis,  is  comprehensive  and 
treats  many  of  the  historical  and  methodological 
issues  which  abound  in  skill  retention  kinds  of 
research. 


Certain  highly  relevant  studies  reviewed  in 
Prophet's  report  (see  Finure  2.6-4)  indicate 
that: 


"In  sum,  . . .USAl  data  suggest  that  basic 
flying  skills  are  surprisingly  well  retained 
over  quite  extended  and  most  difficult  non- 
flying episodes,  i.e.,  time  spent  as  a POW. 
Retraining  to  acceptable  proficiency  levels. 
Smith  and  Matheny  (1976)  conclude,  could  be 
accomplished  in  an  average  of  50  hours  or  less. 
They  conclude  also  that  abolition  of  continua- 
tion training  could  result  in  significant  cost 
savings  for  the  Air  Force  and  should  be  inves- 
tigated. Several  points  should  be  kept  in 
mind  with  reference  to  these  data,  however. 
First,  this  was  a highly  special  and  individ- 
ualized program.  There  is  no  assurance  that 
the  pilots  were  retrained  to  a common  level  of 
proficiency.  In  fact,  it  is  likely  that  they 
were  not,  so  the  retraining  time  measures  may 
be  inappropriate.  Second,  the  retraining  pro- 
gram was  not  oriented  to  tactical  skills  in 
operational  combat  aircraft.  Also,  it  can  be 
argued  that  this  is  a unique  group  of  personnel 
in  terms  of  motivational  factors.  All  in  all, 
however,  it  presents  a convincing  demonstra- 
tion, the  most  dramatic  to  date,  of  the  high 
retention  of  flight  skills  over  extremely  long 
periods  of  time  and  of  the  relative  ease  with 
which  required  proficiency  can  be  regained." 
(Prophet,  1976a,  p.  49). 


While  a considerable  amount  can  be  concluded  in 
the  general  area  of  skill  retention  and  the  reten- 
tion of  flight  specific  psychomotor  and  procedural 
tasks,  there  remains  one  methodological  problem 
that  will  continue  to  require  a solution  before 
definitive  answers  can  be  given  with  regard  to 
effective  out-of-cockpit  time  upon  combat  effec- 
tiveness. Notably,  some  specific  agreed  upon  level 
of  combat  related  performance,  perhaps  within  an 
air  combat  maneuvering  range,  must  be  established 
before  one  can  assess  the  subordinate  question  of 
retention  of  that  specific  performance  level. 


2 . 7 PILOT  ATTITUDES  CONCERNING  THE  SUBSTITUTION 
OF  SIMULATOR  TIME  FOR  ACTUAL  FLIGHT  TJME 

Another  expedient  which  may  have  to  become  a 
reality  given  the  budgetary  considerations  which 
face  the  military  today  is  the  substitution  of 
simulator  "training"  time  for  actual  flight  hours. 
In  a number  of  private  discussions  with  pilots,  we 
came  away  with  the  feeling  that  they  were  very 
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STUDY 

PRINCIPAL  TECHNICAL  CONCLUSIONS 

RECOMMENDED  ACTION 

WRIGHT,  1969 

(1)  FLIGHT  SKILLS  ARE  RETAINED  WELL  FOR  PERIODS  UP  TO  TWO 
YEARS,  AND  RETRAINING  IS  RAPID;  (2)  PROCEDURAL  SKILLS  LACK- 
ING INTERNAL  ORGANIZATION  ARE  RAPIDLY  FORGOTTEN. 

LEAST-COST  OPTION  FOR  THE  ARMY  WOULD  BE  COMPLETE  CESSATION 
OF  PROFICIENCY  FLYING  DURING  NON-FLYING  ASSIGNMENTS  FOLLOWED 
BY  RETRAINING  SPECIFIC  TO  THE  NEXT  ASSIGNMENT.  HE  PUSHES  FOR 
USE  OF  TRAINING  DEVICES  IN  THE  MAINTENANCE  AND  RETRAINING  OF 
FLIGHT  SKILLS. 

SMITH  AND 
MATHENY,  1976 

-SIMILAR  TO  AB(J/E- 

USAF  PILOTS  CAN  BE  RETRAINED  IN  CONTACT  AND  INSTRUMENT  FLIGHT 
SKILLS  IN  SO  HOURS  OR  LESS  AFTER  EXTENDED  PERIODS  OF  NON-FLYING. 
THEY  RECOMMEND  THAT  EXISTING  CONTINUATION  TRAINING  FOR  USAF 
RATED  SUPPUMENT  PILOTS  BE  REEXAMINED  TO  DETERMINE  IF  RECUR- 
RENT TRAINING  MIGHT  BE  FEASIBLE  AND  MORE  COST  EFFECTIVE  THAN 
CONTINUATION  TRAINING  AND  TO  DETERMINE  THE  MOST  EFFECTIVE  USE 
OF  GROUND  TRAINING  DEVICES  IN  MAINTAINING/REGAINING  PILOT  PRO- 
FICIENCY. 

SMOOE, 
HALL,  AND 
MEYER,  1966 

-SIMILAR  TO  ABOVE - 

"RESEARCH  ON  RETENTION,  AS  PRESENTLY  CONCEIVED,  HAS 
REACHED  AN  IMPASSE.  THE  SAME  CONCLUSIONS  CONTINUE  TO 
BE  GENERATED  WITH  VERY  UTTLE  ADDITIONAL  SUBSTANCE 
ADDED." 

THEY  CALL  FOR  PROGRAMMATIC  RESEARCH  ON  FORGETTING  IN  TERMS 
OF  THE  CHARACTERISTICS  OF  COMPLEX  TASKS  AND  OVER  LONGER 
PERIODS  OF  TIME.  AND  THEY  ALSO  .NOTE  THE  NEED  FOR  A BETTER 
UNDERSTANDING  OF  AND  MEANS  FOR  MEASURING  LEVELS  OF  LEARNING 
IN  FLIGHT  TASKS. 

FIGURE  2.6-4  RECENT  SKILL  RETENTION  ANALYSES 


negative  about  any  substitution  of  simulator  time 
for  flight  time,  indicating  that  flight  time  is  al- 
ready at  a minimum.  However,  we  wanted  to  go  be- 
yond the  opinion  of  a few  pilots  and  assess  the 
issue  more  systematically.  We,  therefore,  asked 
the  pilots  in  our  sample  the  question  shown  in 
Figure  2.7-1.  The  essence  of  the  question  suggests 
that  modern  simulators  can  reach  very  high  levels 
of  fidelity  and  that  it  is  implicit  that  pilots 
will  have  to  use  them.  The  question  explicitly 
lets  them  decide  between  various  functions  according 
to  which  they  would  most- wil 1 ingly  substitute  sim- 
ulator for  flight  time. 

The  results  of  our  analysis  of  the  pilot  re- 
sponses is  shown  in  Figure  2.7-1.  Overall,  the 
pilots  are  much  more  willing  to  substitute  simula- 
tor time  for  general  procedures,  instrument  flying 
and  communications  coordination  than  any  of  the' 
other  flight  components  shown  in  Figure  2.7-1  ^ . 

It  is  significant  to  note  that  a number  of 
spontaneous  responses  to  this  question  indicated 
that  simulator  time  was  meant  to  be  an  adjunct  to 
flight  training  time.  Many  pilots  indicated  that 


QUESTION:  9-nio 

SIMULATORS  HAVE  ADVANCED  TO  THE  POINT  WHERE  ALMOST  ALL  VISUAL 
AND  AIRCRAFT  CONTROL  FUNCTIONS  CAN  BE  REALISTICALLY  PRESENTED 
TO  THE  PILOT.  GIVEN  THAT  SUCH  MODERN  SIMULATORS  ARE  BEING  USED, 
TO  WHAT  EXTENT  DO  YOU  FEEL  SIMULATOR  TIME  CAN  BE  SUBSTITUTED 
FOR  FLYING  TIME  FOR  THE  FOLLOWING  FUNCTIONS?  (BASED  ON  100%  FOR 
EACH  FUNCTION) 


FUNCTION 

OF  TIME 
SIMULATORS 

% OF  TIME 
FLIGHT  TRAINING 

GENERAL  PROCEDURES 

42 

68 

TAKE  OFF 

22 

78 

LANDING 

17 

83 

INSTRUMENT  FLYING 

41 

59 

AIR-TO-AIR  COMBAT 
ONE  VERSUS  ONE 

18 

82 

AIR-TO-AIR  COMBAT 
TWO  VERSUS  ONE 

16 

84 

AIR-TO-AIR  COMBAT 
TWO  VERSUS  TWO 

14 

86 

AIR-TO-AIR 

14 

86 

AERIAL  GUNNERY 

17 

83 

COMMUNICATIONS  COORDINATION 

44 

56 

AIR-TO-Gl-.OUND  ATTACK 

17 

83 

FIGURE  2.7-1  PILOT  ATTITUDES  CONCERNING  THE  SUB- 
STITUTION OF  SIMULATOR  TIME  FOR  ACTUAL  FLIGHT 
TIME  FOR  VARIOUS  KINDS  OF  PILOT  TASKS  (FUNCTIONS) 
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the  simulators  should  be  used  in  addition  to  flying, 
not  instead  of  flying.  Despite  this  attitude,  how- 
ever, a relatively  significant  degree  of  training 
time  appears  to  be  acceptable  in  simulators  for 
general  procedures,  instrument  flying,  and  communi- 
cations coordination. 

2.8  PILOT  OPINION  CONCERNING  THE  PERFORMANCE  OF 
PILOTS  IN  AIR  COMBAT  MANEUVERING  RANGES  AND  IN 
COMBAT 

Because  of  our  particular  research  interest, 
this  question  was  extremely  important.  The  thrust 
of  our  recommended  pilot  selection  research  program 
is  to  develop  a battery  of  discriminating  tests 
applied  to  candidate  pilots  very  early  on  in  the 
program  and,  ultimately,  to  correlate  these  tests 
with  the  performance  of  the  same  pilots  in  a struc- 
tured air  combat  maneuvering  range  series  of  engage- 
ments. 

We  were  aware  of  the  frequently  expressed 
reservations  that  pilots  place  upon  ACMR/Is.  These 
reservations  are  understandable  since  although 
there  are  similarities  between  ACMR/Is  and  actual 
combat,  there  are  also  significant  differences. 
Nevertheless,  the  ranges  may  be  close  enough  to 
combat  to  produce  good  correlations.  To  determine 
pilot  opinion  on  this,  pilots  were  asked  whether  or 
not  they  thought  that  performance  in  the  air  combat 
maneuvering  range  would  predict  to  actual  combat. 

Following  the  statement  concerning  air  combat 
maneuvering  ranges  shown  in  Figure  2.8-1,  we  asked 
the  pilots  the  following  two  questions,  "Do  you 
feel  that  pilots  who  perform  well  on  the  ACMR  will 
perform  well  in  actual  air-to-air  combat?"  and,  "Do 
you  think  that  pilots  who  perform  poorly  in  ACMR 
will  do  poorly  in  actual  air-to-air  combat?"  The 
results  to  both  of  these  questions  are  shown  in 
Figure  2.8-1.  Also  shown  in  Figure  2.8-1  are  some 
representative  pilot  comments  concerning  the  limi- 
tation of  ACMRs  in  actually  duplicating  combat. 

About  two  thirds  of  the  pilots  agreed  (or 
strongly  agreed)  that  pilots  who  performed  well  in 


an  ACMR  program  would  perform  well  in  combat;  only 
12%  of  the  pilots  disagreed  (or  strongly  disagreed) 
with  this  premise. 

The  pilots  also  thought  that  poor  ACMR  per- 
formers would  do  poorly  in  combat;  54%  agreed  or 
strongly  agreed. 

Overall,  it  appears  that  the  pilots  were  more 
certain  about  the  good  ACMR  performers  doing  well 
in  combat  than  they  were  about  the  poor  ACMR  per- 
formers doing  poorly  in  combat. 

Based  upon  these  pilot  responses,  we  feel  much 
more  confident  in  advancing  air  combat  maneuvering 
ranges  as  a peacetime  combat  surrogate  within 
which  we  can  assess  the  performance  of  aviators 
and,  in  turn,  relate  this  performance  (good  or  bad) 
to  the  scores  derived  from  a selection  test  battery. 
(See  Sections  6.0  and  7.0  for  Implementation 
Approaches) 

2 . 9 PILOT  OPINION  CONCERNING  SELECTION  STANDARDS 
FOR  PILOTS 

Another  question  of  particular  concern  to  us 
was  the  pilot  opinion  concerning  existing  selection 
standards  for  high  performance  air-to-air  combat 
pilots.  If  the  pilots  were  to  think  that  the 
standards  were  satisfactory  as  they  are  currently 
applied,  then  we,  as  proponents  of  improved  selec- 
tion techniques,  would  be  proceeding  on  very  thin 
ice. 

In  response  to  our  question  (see  Figure  2.9-1), 
we  found  that  two  thirds  of  the  pilots  either 
strongly  agreed  or  agreed  that  standards  should  be 
more  selective  than. those  currently  used  for  assign- 
ment to  air-to-air  combat  aircraft.  Only  11%  dis- 
agreed or  strongly  disagreed  with  the  statement. 

We  did  not  solicit  written  responses  from  the 
pilots  for  this  particular  question.  However,  a 
number  of  general  comments  were  received.  If  we 
were  to  characterize  these  and  the  verbal  responses 
collected  during  our  site  visits,  they  would 
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indicate  that:  "Yes,  of  course,  selection  stand- 

ards need  to  be  improved.  Anybody  can  see  that. 
How  to  do  it,  1 am  not  quite  sure  - you're  the 
psychologist  - you  tell  me." 

This  is  what  the  remainder  of  this  report  is 
concerned  with.  Can  we  devise  a way  to  construct 
and  demonstrate  criteria  for  selecting  air-to-air 


QUESTION: 

DO  YOU  FEEL  THE  PILOTS  WHO  PERFORM  WELL  ON  THE  ACMR  WILL 
PERFORM  WELL  IN  ACTUAL  AIR-TO-AIR  COMBAT? 


AGREE  OPINION  DISAGREE 


QUESTION: 

DO  YOU  THINK  THE  PILOTS  WHO  PERFORM  POORLY  IN  ACMR  WIU  DO 
POORLY  IN  ACTUAL  AIR-TO-AIR  COMBAT? 


AGREE  OPINION  DISAGREE 


fighter  pilots?  The  prediction  to  combat  success, 
of  course,  has  been  the  subject  of  a substantial 
number  of  scientific  studies,  is  the  preoccupation 
of  many  authors  in  the  popular  domain,  and  has  (at 
least  by  implication)  been  treated  by  the  aviation 
selection  research  community  of  the  United  States 
and  foreign  governments.  We  will  now  turn  our 
attention  to  a review  of  the  information  published 
in  this  area. 
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STATEMENT: 

THE  AIR  COMBAT  MANEUVERING  RANGE  (ACMR)  OPERATED  BY  THE  NAVY  AT 
YUMA,  ARIZONA  AND  ITS  AIR  FDRCE  COUNTERPART,  THE  AIR  COMBAT  MA- 
NEUVERING INSTRUMENTATION  (ACMI)  NEAR  LAS  VEGAS  PROVIDE  THE 
CAPABILITY  TD  KEEP  TRACK  DF  A MULTI-AIRCRAFT  AIR  COMBAT  ENGAGE- 
MENT, THE  SYSTEM  TRACKS  EACH  AIRCRAFT'S  POSITION  WITHIN  A 30 
NAUTICAL  MILE  DIAMETER  AREA  EXTENDING  FROM  5000  FT  TO  50,000  FT. 

EACH  AIRCRAFT,  THROUGH  A SPECIAL  INSTRUMENTATION  POO  MOUNTED 
ON  THE  AIRCRAFT,  TRANSMITS  ESSENTIAL  AIRCRAFT  DATA  ( ANGLE  OF 
ATTACK,  "G,"  MACH,  TRUE  AND  INDICATED  AIRSPEED,  ETC.)  TO  THE  GROUND 
STATION.  THESE  DATA  CAN  BE  MONITORED  BY  GROUND  OBSERVERS  ON  LARGE 
SCALE  DISPLAYS,  WHILE  THE  ENGAGEMENT  IS  UNDERWAY  AND/OR  RECORDED 
FOR  LATER  PLAYBACK  TO  THE  AIRCREWS  DURING  THE  DEBRIEFING. 


SELECTED  PILOT  COMMENTS  REGARDING  THE  RELATION  BETWEEN  ACMR  1 
AND  COMBAT: 

YOU  CANNOT  DETERMINE  BY  ANY  TEST  WHAT  A MAN  WILL  DO  WHEN  IT 
BECOMES  NECESSARY  TO  KILL  OR  BE  KILLED.  YOU  CAN  UNDOUBTEDLY 
DETERMINE  MANY  OF  HIS  ABILITIES  BUT  HOT  THIS  ABILITY  TO  ACT  CALMLY 
WHEN  HIS  LIFE  IS  AT  STAKE.  THOSE  WHO  CAN  ACT  CALMLY  IN  TIGHT  CIR- 
CUMSTANCES HAVE  AN  UNBELIEVABLE  ADVANTAGE. 

THE  LIMITATIONS  ARE  THAT  REAL  BULLETS  ARE  HOT  BEING  FIRED.  SOME 
PILOTS  ARE  GOOD  IN  ACM,  BUT  THEN  CANNOT  FACE  THE  REAL  THING. 

ACMR  IS  GOOD  TRAINING  - BUT  LIKE  ALL  TRAINING  IT  ONLY  PREPARES 
THE  MAH  IN  BASICS  (LIKE  GPOUNDAIMULATOR  TRAINING)  HOW  HE  ACTS 
IN  COMBAT  SITUATIONS  MAY  BE  ANOTHER  MATTER,  I.E.,  COOLNESS, 

COMMON  SENSE,  REACTION  TIME,  ETC.  IT'S  A GOOD  TOOL  BUT  NOT  ONE 
TO  USE  IN  CHOOSING  THE  TOP  10-20*.  OF  FIGHTER  PILOTS.  IT  LEAVES 
OUT  HEART-DESIRE,  GUTS  AND  HEAD. 

I THINK  IT’S  GREAT  TRAINING  - BUT  WHEN  THE  GUY’S  LIFE  IS  AT  STAKE 
- WILL  HE  STILL  PERFORM  AS  WELL  ? IT’S  LIKE  PUTTING  ALL  YOUR 
MONEY  ON  A MOVIE  CHARACTER  IN  AN  ACTUAL  STREET  FIGHT. 


FIGURE  2.8-1  PILOT  OPINION  ABOUT  THE  PERFORMANCE  OF  PILOTS  IN  AIR  COMBAT  MANEUVERING  RANGES  AND  IN 
ACTUAL  COMBAT 
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STATEMENT: 

OUR  MODERN  HIGH  PERFORIWNCE  AIR-T04IR  COMBAT  AIRCRAFT  SHOULD 
BE  PILOTED  BY  MEN  WHO  ARE  CHOSEN  BY  STANDARDS  THAT  ARE  MORE 
SELECTIVE  THAN  THOSE  CURRENTLY  USED. 


AGREE  - A BEHER  CRITERION  IS  TO  CHOOSE  PILOTS  BASED 

RIVER  RAT  UPDN  THE  REQUIRED  DUTIES.  THE  AIR-TO-AIR 

COMBAT  AND  TACTICAL  GROUND  ATTACK  IN  HEAVILY 
DEFENDED  AREAS  REQUIRE  THE  BEST  PILOTS. 
SPECIAUZEO  PILOTS  SUCH  AS  AIRLINE  AND  MAC 
PILOTS  SHOULD  BE  SELECTED  ON  CRITERIA  EM- 
PHASIZING THEIR  ABILITY  TO  BE  GOOD  INSTRUMENT 
PILOTS  AND  BE  GOOD  AT  INTRA-PLANE  CREW  COOR- 
DINATION. 

AGREE  -THE  PRESENT  SYSTEM  SHOWS  THAT  THOSE  WITH  A 

RIVER  RAT  COLLEGE  DEGREE  ARE  MOST  LIKELY  TO  COMPLETE 

TRAINING,  THE  TYPE  OF  DEGREE  MAKES  NO  DIFFER- 
ENCE. IF  THIS  IS  THE  OVERRIDING  CRITERION,  I 
DISAGREE.  SOME  OF  THE  BEST  STICK  AND  RUDDER 
PILOTS  I HAVE  EVER  FLOWN  WITH  ENTERED  TRAINING 
WITH  A HIGH  SCHOOL  DIPLOMA.  DURING  THEIR 
CAREER  THEY  COMPLETED  COLLEGE.  I THINK  A PER- 
SON'S INNATE  INTELLIGENCE  IS  IMPORTANT  BUT  HB 
DESIRE  TO  BE  A PILOT  B THE  GREATEST  DRIVE  TO 
COMPLETE. 


SELECTED  PILOT  COMMENTS  FROM  THOSE  MEN  WHO  DISAGREE  OR 
STRONGLY  DISAGREE: 


SELECTED  PILOT  COMMENTS  FROM  THOSE  MEN  WHO  AGREE  OR 
STRONGLY  AGREE: 


STRONGLY 

DISAGREE 

RIVER  RAT 


- TO  BE  COST  EFFECTIVE  'ELECTION  MUST  BE  MADE 
ON  ABILITY  TO  COMPLETE  UPT. 


AGREE 

AMERICAN 
FIGHTER  ACE 


AGREE 

AMERICAN 
FIGHTER  ACE 


AGREE 
AMERICAN 
FIGHTER  ACE 


AGREE 

AIR  NATIONAL 
GUARD 


- BESIDES  THE  BASIC  PHYSICAL  AND  MENTAL  ABILITY 
TO  COMPLETE  TRAINING  THE  INDIVIDUAU  CHOSEN 
SHOULD  HAVE  A STRONG  DESIRE  TO  BE  PILOTS!! 

GIVEN  HEALTH  AND  NORIML  MENTAL  ABILITY  THE 
MEN  WHO  WANT  TO  BE  WIU  END  UP  THE  BEST  IN  THE 
BUSINESS  AND  WILL  KEEP  AT  IT  LDNGER  THAN  THOSE 
CHOSEN  BY  ANY  YARDSTICK  DF  ACADEMIA. 

- G)  COMPLETE  BACKGROUND  INFORMATIDN;  (2)  COM- 
PLETELY DBREGARD  ABOVE  IF  CERTAIN  PERSONALITY 
TRAITS  ARE  EVIDENT,  I.E.,  HONESTY,  INTEGRITY,  DE- 
TERMINATION. PATRIOTISM.  RESTRAINED  EGOTISM: 

(3)  DISREGARD  EARLY  SCHOLASTIC  ACHIEVEMENTS 
AND  CONCENTRATE  ON  CURRENT  DESIRE  TD  ACHIEVE. 

- COST  WOULD  APPEAR  TO  bJ  A DOMINANT  FACTOR  IN 
SELECTING  ONLY  THE  MAN  WITH  THE  GREATEST  POTEN- 
TIAL. THE  PROBLEM  SEEMS  TO  STEM  FROM  THE  DEVELOP- 
MENT AND  EMPLOYMENT  OF  THE  SELECTION  CRITERIA. 
COULD  IT  BE  MODIFIED  TD  ISOLATE  AND  IDENTIFY  ON  A 
“WHOLE  MAN’’  CONCEPT  AS  OPPOSEO  TO  ONE  DESIGNED 
TO  IDENTIFY  PRIMARILY  SCHDLASTIC  ABILITY. 

- SPECIFIC  CRITERION  FOR  SPECIFIC  PILOT-TYPE 
OUTPUTS  SHOULD  BE  ESTABLISHED.  SOME,  BUT  NOT 
ALL.  WOULD  BE  THE  SAME  (I.E„  FDRMATIDN  FLIGHT 
APTITUDE). 


STRONGLY 

DISAGREE 

AMERICAN 
FIGHTER  ACE 

STRONGLY 

DISAGREE 

AMERICAN 
FIGHTER  ACE 

DISAGREE 

AMERICAN 
FIGHTER  ACE 


DISAGREE 

NAVY 

MIG  KILLER 


- AN  EXPERIENCED  INSTRUCTOR  CAN  PICK  A DUD  BY 
WATCHING  HB  REACTIDNS  AS  HE  DRIVES  A CAR  (I 
PREDICTED  MY  NEPHEW  WOULD  WASH  OUT  OF  FLIGHT 
TRAINING.  HE  DID).  THERE  MUST  BE  A TEST  OF 
REFLEXES  AND  EMERGENCY  DECISION  MAKING. 

- USELESS  IF  THEY  CAN’T  COMPLETE  THE  PILOT 
TRAINING  - IF  THEY  HAD  DESIRE  AND  DETERMINA- 
TION I WOULD  TRY  TD  BE  PATENT  WITH  THEM. 

SOME  SLOW  LEARNERS  TURN  OUT  TO  BE  EXCELLENT. 

- IT  B IMPOSSIBLE  TO  PREJUDGE  A PERSDN’S  INNER 
DRIVE  - THAT  FDRCE  THAT  MOTIVATES  HIM  TO  DRIVE 
DN  IN,  WHEN'LDGIC  WOULD  CAUSE  HIM  TD  HESITATE. 
THERE  IS  NO  FEASIBLE  WAY  - YET,  WHO  WOULD  VOTE 
OH  SOMEONE  THEY  THOUGHT  WOULDN’T  COMPLETE 
THE  TRAINING.  OBSERVATION  B THE  KEY  - BUT,  WHO 
REALLY  GETS  TO  SEE  THE  SELECTEE  IN  ACTION? 

- MOTIVATION,  ATTITUDE,  AND  PRECDNCEIVED  NOTIDH 
OF  ONE’S  SELF  SHOULD  BE  DETERMINED.  DOES  THE 
PERSON  WANT  TO  BECOME  A FIGHTER  PILOT?  MOST 
ANYONE  CNI.  BUT  FEW  WANT  TO  BADLY  ENOUGH  TO 
BECOME  VERY  GOOD.  THE  TERM  FIGHER  PILOT  IS 
MORE  AN  INSTINCT  THAN  DEFINITION.  MANY  PEOPLE 
WHO  HAVE  NEVER  FLOWN  AIRPLANES  HAVE  THE 
FIGHTER  PILOT  INSTINCT  AND  ATTITUDE. 


FIGURE  Z.9-1  PILOT  OPINION  CONCERNING  SELECTION  STANDAROS  FOR  PIL07S 
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2.10  SUMMARY 

Questionnaires  tapping  pilot  opinion  on  nine 
major  policy  issues  were  distributed  to  members  of 
seven  pilot  organizations.  These  were  members  of 
the  American  Fighter  Aces  Association,  Navy  MIG 
Killers  Association,  Red  River  Valley  Fighter 
Pilots  Association,  Air  National  Guard  (in  St. 

Louis,  Missouri),  Navy  ACEVAL-AIMVAL  Program,  Air 
Force  ACEVAL-AIMVAL  Program,  and  the  Aggressor 
Souadron  at  Nellis  Air  Force  Base.  Of  the  735 
questionnaires  distributed,  373  (51%)  were  returned. 

Results  from  the  analyses  of  these  responses 
were  as  follows;  most  pilots: 

0 Disagreed  with  the  concept  of  the  univer- 
sally assignable  pilot  (68%) 

0 Agreed  that  a multi-track  training  system 
would  be  superior  to  the  present  system 
in  which  all  pilots  receive  the  same 
undergraduate  training  (6U) 

0 Agreed  that  pilots  should  be  dedicated  to 
the  air-to-air  combat  mission  with  no 
staff  assignments  (72%)'* 

0 Agreed  that  high  performance  air-to-air 
combat  aircraft  should  be  piloted  by 
individuals  with  sufficient  training 
sorties  to  make  them  combat  ready  at  all 
times  (89?;) 

0 Agreed  that  out-of-cockpit  assignments 
will  have  an  effect  on  air-to-air  combat 
readiness  (79%) 

0 Agreed  that  there  would  be  a relationship 
between  performance  in  air  combat  maneu- 
vering ranges  and  performance  in  air-to- 
air  combat  (65%  and  54%  on  two  related 
questions) 

0 Agreed  that  air-to-air  combat  aircraft 
should  be  piloted  by  individuals  chosen 
by  more  stringent  selection  standards 
than  present  ones  (66%). 
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One  of  two  remaining  questions  dealt  with  attitudes 
toward  substituting  simulator  time  for  flight  time. 
For  some  tasks  (general  procedures,  instrument  fly- 
ing, and  coninuni cations  coordination;,  Uie  pilots 
stated  that  they  were  willing  to  replace  significant 
percentages  of  flight  time  with  simulator  time  (41% 
to  44%).  The  final  question  dealt  with  budget  cuts 
in  proficiency  training.  More  pilots  stated  that 
it  would  be  better  to  have  fewer  pilots  trained  to 
top  proficiency  (33%)  or  a mixture  of  pilots  - some 
at  full  and  some  at  partial  efficiency  (41%)  than 
to  have  a full  complement  of  pilots  trained  to  an 
intermediate  level  within  a reduced  budget  (26%). 

Overall,  these  data  suggest  that  most  of  the 
pilots  endorse  major  changes  in  training,  manage- 
ment, and  selection  practices  for  the  fighter 
pilot.  This  report  addresses  the  question  of  how 
to  improve  fighter  pilot  selection  procedures. 


‘’in  a similar  question  which  tapped  attitudes 
toward  the  concept  of  a contract  pilot,  only  48% 
of  the  total  pilot  population  agreed.  However, 
64%  of  current  pilots  sampled  (i.e.,  excluding 
pilots  from  the  American  Fighter  Aces  Association) 
endorsed  the  concept  of  the  contract  pilot. 
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3.0  DATA  CONCERNING  THE  ATTRIBUTES  OF 
THE  COMBAT  EFFECTIVE 

This  section  of  our  report  establishes  the 
attributes,  i.e.,  the  characteristics  which  have 
been  associated  with  the  combat  effective  in  any 
combat  role,  and  in  particular,  the  characteristics 
and  critical  skills  of  the  effective  air-to-air 
combat  pilot.  In  all,  five  major  data  sources  have 
been  used  and  are  presented  in  the  following  sec- 
tions; (3.2)  Scientific  studies  of  combat  aviators 
in  World  War  II,  Korea,  and  Southeast  Asia;  (3.3) 
Scientific  studies  of  nonaviator  combat  and  combat 
surrogates  with  special  emphasis  on  U.S.  Army  com- 
bat infantry  in  Korea;  (3.4)  U.S.  Air  Force  and 
U.S.  Navy  pilot  selection  and  flight  training 
research  from  World  War  II  to  the  present;  (3.5) 

The  fighter  pilot  selection  programs  of  the  govern- 
ments of  Germany  and  Japan  during  World  War  II  and 
the  current  Israeli  program;  (3.6)  Pilot  inputs 
from  biographical  treatments  of  World  War  II 
fighter  pilots,  written  illustrations  of  ace 
fighter  pilots  provided  to  us  by  100  American  aces, 
and  data  from  specially  prepared  questionnaires 
which  were  distributed  to  some  800  American  fighter 
pilots. 

Using  this  elaborate  data  base,  we  will  develop 
a composite  "profile"  of  the  characteristics  and 
critical  skills  which  are  known  or  can  be  hypothe- 
sized to  be  related  to  air-to-air  combat  effective- 
ness (see  Section  4).  Before  we  begin  our  system- 
atic review,  however,  we  should  take  some  time  to 
develop  a context  within  which  to  discuss  combat 
effectiveness.  In  Section  3.1  we  will  look  at  a 
nunter  of  factors,  such  as  the  issue  of  opportunity 
for  air  kills,  so  that  we  may  gain  some  understand- 
ing of  the  various  complexities  which  abound  in  any 
analysis  of  this  kind.  Additionally,  we  will  re- 
view what  some  famous  soldiers  have  to  say  about 
why  men  fight. 
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3 . 1  A BRIEF  ANALYSIS  OF  THE  ISSUES  OF  OPPORTUNITY 
CHANCE,  LUCK,  SURVIVAL  OF  THE  FITTEST,  AND  LEARNING/ 
EXPERIENCE  AS  THEY  RELATE  T0_  FIGHTER  PILOT  COMBAT 
EFFECTIVENESS 

During  an  interim  presentation  of  this  report, 
Erich  Hartmann,  with  his  352  kills,  was  cited  as  a 
model  of  confcat  effectiveness.  A member  of  the 
audience  interrupted  the  briefing.  "I  wouldn't  use 
Hartmann,"  he  advised.  "After  all,  there  was  a 
tremendous  opportunity  for  kills  on  the  Russian 
front;  you  can't  use  Hartmann." 

From  our  perspective,  excluding  Erich  Hartmann 
from  the  roles  of  the  combat  effective  is  extreme. 
Nevertheless,  the  issue  of  opportunity  for  air 
kills,  as  well  as  the  related  issues  of  chance, 
luck,  survival  of  the  fittest,  and  leaminq 
(experience)  need  to  be  considered  in  the  analysis 
of  the  combat  effective  aviator. 

The  analysis  of  these  issues  that  is  presented 
here  is  largely  heuristic;  a relatively  quick  review 
to  try  to  sort  these  issues  out,  and  to  present 
what  conclusions  appear  to  be  warranted.  Analysis 
of  these  issues  also  serves  to  create  a "context" 
within  which  we  should  evaluate  the  combat  effective 
air-to-air  fighter  pilot. 

3.1.1  Opportunity  - The  issue  of  opportunity, 
the  chance  to  engage  the  enemy,  is  clearly  a deci- 
sive factor  in  the  number  of  kills  a pilot  can 
possibly  achieve.  While  some  American  and  Allied 
pilots  in  World  War  II  were  able  to  achieve  impres- 
sive kill  records,  it  must  be  understood  that  the 
scores  of  American  and  Allied  pilots  were  heavily 
influenced  by  opportunity.  Germany  and  Japan  kept 
many  of  their  fliers  on  the  front  lines  throuohout 
the  entire  war.  It  is  from  these  pilots,  particu- 
larly the  Germans,  that  we  can  see  the  truly  amazing 
number  of  kills  that  can  be  achieved  when  opportun- 
ity is  virtually  unlimited.  In  Korea,  as  we  shall 
soon  see,  opportunity  was  a factor  which  clouded 
some  of  the  analyses  which  were  conducted.  In 
Southeast  Asia,  the  limited  number  of  opportunities 
for  so  many  of  our  combat  aviators  made  the  analysis 
of  that  war's  kill  data,  with  respect  to  aviator 
qualities,  virtually  impossible. 
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The  issue  of  opportunity  as  it  is  related  to 
kill  scores  is  dramatically  underscored  by  the  kill 
data  from  the  United  States,  England, and  Germany  in 
both  World  War  I and  World  War  II  for  each  of  those 
countries'  ten  top  aces.  The  summary  records  of 
these  aces  are  shown  in  Figure  J.1-1.  The  ten  top 
German  pilots  of  World  War  II,  some  of  whom  were 
able  to  fly  "from  the  first  to  the  last,"  and  many 
against  Russian  opponents  flying  largely  ground 
support  aircraft,  were  able  to  achieve  a staggering 
2,568  kills.  According  to  Hans  Ring,  the  German 
fighter  pilot  historian  (Sims,  1967),  a mere  300 
German  pilots  destroyed  30,000  Russian  aircraft. 
This  most  clearly  reflects  what  highly  accomplished 
combat  pilots  can  achieve,  given  nearly  limitless 
opportunities  for  kills. 
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WWI 

WWII 

UNITED  STATES 

143 

294 

ENGLAND 

5S2 

314 

GERMANY 

497 

2568 

FIGURE  3.1-1  TOTAL  SCORES  OF  TOP  TEN  ACES 
(Taken  from  Nei$$,  1966) 


German  and  Japanese  policy  apparently  kept 
their  fighter  pilots  in  near  continuous  duty  for 
the  duration  of  the  war  (Constable  and  Toliver, 
1968;  Sakai,  1958),  or  until  they  were  killed  or 
disabled.  Undoubtedly,  some  pilots  were  withdrawn 
from  combat  operations  for  other  reasons  (e.g., 
fatigue,  instructor  duty),  but  it  appears  that, 
except  for  very  special  pilots  who  were  particu- 
larly distinguished  (e.g.,  Galland,'  Rudel and 
Sakai 3),  the  Axis  pilots  were  kept  on  continuous 
combat  status. 

The  British  and  Americans  pulled  many  of  their 
high  scoring  pilots  (e.g.,  Joe  Foss)  or  rotated 
their  pilots  to  noncombat  roles  following  tours  of 
a given  duration  or  a specific  number  of  missions. 
In  addition  to  this  fact,  it  may  often  have  been 
the  case  that  a nominal  tour  may  not  have  resulted 
in  many  combat  opportunities.  As  an  example  of 
the  amount  of  flying  it  takes  to  make  contact  with 
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the  enemy,  we  looked  at  some  representative  records 
from  the  American  Eighth  Fighter  Command  operating 
against  the  Germans  In  World  War  II. 


Official  statistical  engagement  and  kills 
summaries  of  the  American  Eighth  Fighter  Command 
operating  against  German  aircraft  from  1 July  1943 
to  30  June  1944  indicate  that  the  average  encounter 
rate  for  American  fighter  pilots  was  only  one  per 
25  combat  sorties,  with  the  kill  rate  per  sortie 
being  substantially  below  that  (Johnson,  1944). 
American  pilots,  in  this  group  at  least,  did  not 
have  the  kind  of  numerous  engagement  opportunities 
which  have  been  popularly  imagined. 


Figure  3.1-2  presents  a monthly  summary  of 
data  on  these  operations.  Especially  interesting 
are  the  comparisons  between  the  columns  summarizing 
total  sorties  per  month,  sorties  involving  combat, 
and  enemy  aircraft  destroyed.  We  find  that,  over 
the  12  month  period,  it  took  nearly  94,000  sorties 
to  produce  just  under  4,000  combat  engagements  to 
achieve  2306  aircraft  destoyed. 


'Galland,  of  course,  had  become  a national  hero 
having  sored  nearly  100  Spanish  and  British  kills 
by  the  end  of  the  Battle  of  Britain.  Hitler,  in 
making  Galland  General  of  the  Luftwaffe  Fighter 
Command,  ordered  him  off  operational  flight  duty 
(Constable  and  Toliver,  1968).  However,  near  the 
end  of  the  war,  Galland  fell  from  grace  with  Hitler 
and  returned  himself  to  combat.  Flying  in  his 
"Sguadron  of  Experts,"  he  added  seven  more  kills  in 
an  ME-262  Jet.  He  ended  the  war  with  a total  of 
104  kills. 

^Rudel , the  unparalleled  Stuka  pilot,  finished 
the  war  with  2530  operational  sorties  and  a medal 
for  valor  especially  designed  by  Hitler,  and  awarded 
only  to  Rudel  (Rudel,  1958).  Rudel  was  ordered  by 
Hitler  to  stop  flying  more  than  once,  but  most  ser- 
iously after  he  had  lost  a leg  to  anti-aircraft  fire, 
while  attacking  a Russian  tank  with  only  one  round 
of  30mn  ammunition  left.  Rudel  ignored  the  order 
and,  incredibly,  returned  to  combat  flying  in  only 
six  weeks. 

^Sakai,  Japan's  top  scoring  pilot  to  survive  the 
war  was  ordered  off  flying  status  after  his  60th 
kill  because  of  serious  wounds,  including  the  loss  of 
an  eye  suffered  in  aerial  combat  over  Guadalcanal 
(Sakai,  1958).  Late  in  the  war,  he  returned  to  com- 
bat and  scored  four  more  Mils  flying  night  missions 
over  Japan. 
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In  Korea,  the  total  number  of  interceptor 
sorties  flown  compared  with  the  total  number  of 
t'.ircraft  destroyed  evidenced  a ratio  of  about  one 
kill  per  88  sorties  (Futrell,  1961).  This  is 
approximately  one-half  the  kill  per  sortie  rate 
obtained  by  the  Eighth  Fighter  Command  during 
World  War  II.  It  does  suggest  that,  just  as  we 
found  in  World  War  II,  American  pilots  did  not 
typically  have  as  great  an  opportunity  to  engage 
and  destroy  the  enemy  as  might  be  imagined. 


Strawbridge  and  Kahn  (1955)  present  some 
interesting  statistics  on  the  Korean  War: 


"From  14  December  1950  to  27  July  1953,  the 
F-86s  of  the  4th  F.I.W.  met  the  MlG-15  in 
combat.  During  this  period  the  4th  F.I.W. 
flew  a total  of  45,143  effective  sorties, 
fired  2,963,000  rounds  of  ammunition, 
destroyed  an  estimated  484  enemy  aircraft 
in  aerial  combat,  and  lost  an  estimated  '18 
F-86s  to  enemy  aircraft 

"The  pilots  of  the  4th  F.I.W.  varied  in  both 
their  combat  performance  and  noncombat  char- 
acteristics. However,  before  considering 
such  differences,  consider  first  the  perfor- 
mance of  a ‘typical  pilot,'  one  who  possesses 
an  attribute  the  measure  of  which  lies  in 


the  middle  50  percent  of  the  distribution 
of  that  attribute  (the  interguarti le  range). 
Twenty-five  percent  of  the  pilots  have  less 
of  the  attribute  and  25  percent  have  more 
of  the  attribute  than  he  does.  In  this 
sense  the  typical  pilot  is  a statistical 
concept.  The  greater  the  number  of  attri- 
butes considered,  the  less  likely  that  any 
one  pilot  is  'typical'  with  respect  to 
all  of  them.  Interest  in  the  typical  pilot 
centers  chiefly  in  illustrating  that  these 
individuals  were  not  the  ones  primarily 
responsible  for  victory  over  the  enemy. 

"Jet  fighter  pilots  have  often  been  charac- 
terized as  'hungry  tigers.'  The  following 
few  statistics  show  how  well  the  'typical' 
tiger's  appetite  was  satisfied.  The  typical 
pilot  flew  41.5-102.4  combat  missions  in 
Korea.  During  all  of  these  missions  he 
sighted  1.9-12.6  enemy  aircraft  formations 
while  flying  as  a leader  and  of  these  he 
was  able  to  encounter  1.7-9. 2 enemy  air- 
craft. Of  these  aircraft  0.3-4. 3 were  fired 
upon,  and  ht  was  credited  with  destroying 
0.4-1. 5.  These  relations  are  shown  in 
Figure  [3.1-3J.  . . 

"In  general ,.. .the  typical  pilot  was  given 
little  opportunity  to  contact  the  enemy. 
Combatwise  he  may  be  characterized  as  a 
pilot  who  flew  most  of  his  missions  as  a 
wingman,  eventually  flew  a few  missions  as 
element  or  flight  leader,  and  during  these 
missions  made  limited  contact  with  the 
enemy.  It  would  appear  that  the  typical 
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FIGURE  3.1-2  THIS  FIGURE  SHOWS  A MONTHLY  SUMMARY  OF  OPERATIONS  DATA  FOR 
THE  U.S.  EIGHTH  FIGHTER  COMMAND.  (Adapted  from  Official  Eighth  Fighter  Command 
Document:  Johnson,  1944) 
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hungry  tiger  was  caged  by  the  nature  of  the 
operational  situation,  with  its  structure 
of  responsibility,  and  by  the  tactical  situ- 
ation. The  effectiveness  of  the  pilot's 
combat  performance  cannot  be  properly  eval- 
uated because  he  had  too  few  contacts  with 
the  enemy."  (pp.  9,  15-17) 


FIGURE  3.1-3  THIS  FIGURE  SHOWS  THE  INTER- 
QUARTILE RANGE  OF  NUMBER  OF  MISSIONS.  SIGHTINGS  AS 
LEADER,  FIRINGS,  AND  KILLS  FOR  THE  TYPICAL  F-86 
PILOT  IN  A TOUR  IN  KOREA  (Adapted  from  Strawbridge 
and  Kahn,  1955;  See  Teit) 

Two  research  groups,  working  under  Air  Force 
sponsorship  during  the  Korean  period,  were  conscious 
of  the  issue  of  opportunity  in  their  analyses  of 
pilot  kills  and  aviator  qualities.  The  first  re- 
search group,  Torrance,  Rush,  Kohn,  and  Doughty 
(1957),  in  conducting  their  research,  selected 
800  F-86  pilots  who  had  at  least  25  counterair 
missions.  Of  this  group  of  800,  over  half  (53.5%) 
were  unable  to  record  a kill.  At  a global  level,  it 
may  in  fact  be  that  25  counterair  missions  did  not 


constitute  an  adequate  opportunity  for  these  pilots 
when  one  considers  that  the  overall  kill  per  sortie 
ratio  was  about  1 to  88,  and  in  light  of  Strawbridge 
and  Kahn's  (1955)  "Hungry  Tiger"  characterization. 

The  other  research  group,  Strawbridge  and  Kahn 
(1955),  strongly  objected  to  the  use  of  kill  records 
per  se  to  identify  confcat  effective  pilots.  On  the 
one  hand,  their  argument  is  somewhat  overdrawn;  of 
course  the  Korean  War  aces  were  cont>at  effective. 

On  the  other  hand,  kills  per  opportunity  would 
constitute  a valuable  measure  of  pilot  combat 
effectiveness.** 

As  reviewed  in  Section  1.2.3,  Strawbridge  and 
Kahn  (1955)  analyzed  the  operational  flight  records 
of  520  pilots  of  the  Fourth  F.I.W.  (Fighter  Inter- 
ceptor Wing)  who  flew  in  Korea.  From  this  sample, 
the  records  of  69  pilots  who  had  sufficient  oppor- 
tunity for  MIG  kills  (15  or  more  encounters  with  the 
enemy  while  serving  as  an  element  leader)  were 
selected  for  further  analysis.  Large  individual 
differences  were  found.  Some  pilots  converted  70 
to  80  percent  of  their  enemy  encounters  into  firing 
passes,  and  60  to  70  percent  of  their  firing  passes 
resulted  in  kills.  Other  pilots  converted  only  15 
percent  of  their  enemy  encounters  into  firing  passes 
and,  in  some  instances,  only  0 to  10  percent  of 
their  firing  passes  resulted  in  kills.  This  study 
and  others  conducted  during  the  Korean  War  deserve 
special  attention  since  the  factor  of  opportunity 
is  a major  variable  in  the  analysis  of  Southeast 
Asia  air  war  records. 


"•An  interesting  historical  footnote  concerning 
opportunity  is  the  comparison  between  the  records 
of  German  jet  aces  of  World  War  II  and  those  of 
their  American  counterparts  in  Korea.  The  Ameri- 
cans, during  the  three  year  Korean  War,  were  able 
to  produce  38  aces,  the  highest  scoring  among  them 
gaining  16  victories.  The  German  jet  aces  of  World 
War  II  were  able  to  accomplish  nearly  the  same  in 
the  last  months  of  World  War  II,  but  had  greater 
opportunity  to  engage  the  enemy.  They  had  22  jet 
aces  during  this  period  and,  coincidentally,  their 
top  scorer  achieved  16  victories  (Constable  and 
Toliver,  1968). 
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While  much  can  be  learned  from  an  analysis  of 
the  Southeast  Asia  air  war,  such  as  that  represented 
by  the  Red  Baron  reports,^  we  feel  that,  for  our 
purposes,  only  a limited  amount  can  be  gleaned  from 
this  source  of  information.  The  fact  that  liter- 
ally thousands  of  U.S.  pilots  flew  combat  missions 
in  Southeast  Asia  and  only  about  200  enemy  aircraft 
were  destroyed  during  the  entire  Southeast  Asian 
conflict,  makes  opportunity  an  overriding  factor. 

In  all,  the  Air  Force  accounted  for  IBl  enemy 
air-to-air  kills  during  the  Southeast  Asian  con- 
flict. For  these  kills,  a total  of  205  Air  Force 
pilots  and  weapons  systems  operators  (WSOs)  were 
credited  with  one-half  or  more  victories.  Only  26 
of  that  number  were  credited  with  two  or  more  kills. 
The  highest  scorer.  Captain  Charles  B.  De  Bellevue, 
a WSO,  was  credited  with  six  kills  (see  Figure 
3.1-4). 


Many  pilots  who  flew  large  numbers  of  missions 
in  Southeast  Asia  probably  never  encountered  enemy 
fighter  aircraft.  Because  of  the  issue  of  oppor- 
tunity, many  of  the  pilots  from  the  Southeast  Asian 
conflict  that  we  interviewed  did  not  believe  that  a 
pilot  with  one  air  kill  significantly  stood  above 
other  pilots;  the  other  pilots,  may  not  have  had  an 
opportunity  for  a kill.  Furthermore,  it  is  believed 
by  some  Air  Force  and  Navy  pilots  that  certain 
selected  pilots  were  purposely  given  every  conceiv- 
able opportunity  to  achieve  air  kills  in  order  that 
their  respective  services  could  produce  an  ace. 

We  cannot  sum  it  up  as  well  as  one  seasoned 
fighter  pilot  commander  has  done  in  his  response 
to  our  questionnai re.  Here  is  his  feeling  on  the 
matter: 

"I  could  relate  events  illustrating  the 
qualities  possessed  by  men  who  would  have 
been  'top  scorers'  had  opportunity  existed. 

They  flew  and  fought  over  North  Vietnam  and 
were  as  good  or  better  than  anyone  1 had 
flown  with  in  the  previous  20-odd  years." 

3.1.2  Chance  - One  of  the  perennial  questions 
which  is  asked  concerning  flight  kill  records  is 
whether  or  not  they  could  be  accounted  for  by 
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WSO 
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3 
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F40 
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LTC  CARL  G BAILY 

F40 
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2 

LTC  LYLE  L BECKERS 
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AC 

2 

CPT  MAX  C BRESTEL 
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2 

MAJ  PHILIP  P COMBIES 

F4C 

AC 

ILT  STEPHEN  BCROKER 
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2 
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WSO 

2 
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AC 

2 

CPT  FREDERICK  S OLMSTED  JR 
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AC 

2 

MAJ  RICHARD  M PASCOE 

F4C 

AC 

2 

CPT  LAWRENCE  H PETTIT 

F4D 

WSO 

2 

CPT  EVERETT  T RASPBERRY  JR 

F4Ct) 

AC 

2 

MAJ  GARY  L RETTERBUSH 

F4E 

AC 

2 

CPT  DARRELL  D SIMMONDS 

F40 

AC 

2 

CPT  CALVIN  B TIBBETT 

F40E 

AC 

2 

ILT STEPHEN  A WAYNE 

F4C 

P 

2 

CPT  NORMAN  E WELLS 

F4C 

P 

2 

FIGURE  3.1-4  AIR  FORCE  PERSONNEL  WITH  TWO  OR  MORE 
AERIAL  VICTORIES  IN  SOUTHEAST  ASIA  (Taken  from  U.S. 

Air  Force  Combat  Victory  Credits  Southeast  Asia,  1974) 


chance.®  Considering  only  decisive  encounters, 
chance  is  defined  as  having  a .5  probability  of  a 
kill  or  being  shot  down. 


Figure  3.1-5  summarizes  the  flight  kill  records 
of  2156  pilots  of  the  eighth  Air  Force  Fighter  Com- 
mand who  had  at  least  one-half  air-to-air  kill 
against  the  Germans  in  World  War  II.  An  additional 
749  pilots  had  air-to-ground  kills,  but  no  air-to- 
air  kills.  As  noted  in  the  Introduction  and  the 
Executive  Summary,  the  data  shown  in  this  figure 
underscore  the  remarkable  achievement  of  a rela- 
tively small  group  of  pilots. 


®For  a listing  of  the  Red  Baron  reports  see 
Figure  3.2-1 . 

‘Ordinarily,  this  issue  is  focused  on  high  scor- 
ing aces;  after  all.  the  argument  goes,  with  enough 
pilots  someone  is  bound  to  make  a big  score  (by 
chance).  While  we  will  look  at  this  question  in 
particular,  we  will  also  look  at  data  that  relate 
to  two  other  questions  which  could  involve  "chance" 
explanations.  They  are  (1)  do  fledgling  pilots  do 
worse  than  chance?  and  (2)  can  overall  differences 
in  kill  ratios  between  opponent  countries  be 
"explained"  by  chance? 
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FIGURE  3.1-5  THIS  FIGURE  SHOWS  THE  NUMBER  OF  EIGHTH  AIR  FORCE 
PILOTS  WITH  AIR-TO-AIR  KILLS  RANGING  FROM  1/2  KILL  TO  31  KILLS 
AGAINST  THE  GERMANS  IN  WORLD  WAR  II.  (From  Final  Report  of  Assessed 
Fighter  Claims  Against  Enemy  Aircraft,  August  1942-  April  1945;  Published 
September,  1945) 


Weiss  (1966)  has  performed  an  analysis  of 
air-to-air  confcat  data  which  are  generally  consid- 
ered most  relevant  to  the  issue  of  survival  of  the 
fittest/leaming.  While  we  will  review  his  work 
in  more  detail  in  subsection  3.1.4,  his  analysis 
is  very  relevant  in  considering  the  chance  issue. 
According  to  his  analysis,  fifteen  percent  of  the 
pilots  in  his  sample  had  a better  than  even  chance 
of  surviving  their  first  decisive  encounter  (deci- 
sive means  that  one  of  two  opponent  aircraft  in  an 
encounter  is  destroyed).  Pilots  who  survived  their 
first  few  decisive  encounters,  on  the  other  hand, 
had  a much  better  than  "chance"  probability  of 
winning  subsequent  encounters. 

Constable  and  Toliver  (1968),  in  their  review 
of  German  aces,  have  presented  some  interesting 
"Tops  and  Firsts"  for  the  Luftwaffe  fighter  pilots 
of  World  War  II  Figure  3.1-6  is  adapted  from 


their  excellent  book;  inspection  will  show  what 
some  aviators  are  able  to  accomplish  given  the 
opportunity.  The  kill  records  of  high  scoring 
aces  from  all  nations,  but  particularly  from 
Germany,  in  World  War  II,  appear  so  improbable 
that  chance  alone  can  be  ruled  out  by  any  reason- 
able person. 

Figure  3.1-7,  again  adapted  from  Constable  and 
Toliver  (1968),  shows  the  distribution  of  air  kills 
for  the  107  German  pilots  of  World  War  II  with  more 
than  100  kills.  These  records  are  truly  astonishing 
whether  they  are  chance  or  not.  From  among  this 
group,  taking  a single  example,  we  find  the  German 
pilot,  Marseille,^  achieving  150  aerial  kills  over 


^Constable  and  Toliver  (1968,  p.  100)  report 
that  Marseille  was  forced  to  bail  out  some  six 
times  as  a result  of  his  battles  prior  to  his 
North  African  combat. 
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TOPS  AND  FIRSTS  - LUFTWAFFE,  WORLD  WAR  II 

TOP  ACE 

MAJOR  ERICH  HARTMANN 
TOP  NIGHT  FIGHTER  ACE 

352  VICTORIES 

MAJOR  HEINZ  SCHNAUFER 
FIRST  ACE  TO  EXEED  BARON  MANFRED  VON 
RICHTOFEN’S  WORLD  WAR  1 SCORE  OF  80 
CAPTAIN  WERNER  MOELDERS 
FIRST  TO  SCORE  lOO  VICTORIES 

121  VICTORIES 

MAJOR  WERNER  MOEIDERS 
FIRST  TO  SCORE  250  VICTORIES 

15  JULY  1 Ml 

MAJOR  WALTER  NOWOTNY 
MOST  KILLS  SCORED  IN  A SINGLE  DAY 

14  OCTOBER  1M3 

MAJOR  EMIL  LANG 

MOST  KILLS  ON  A SINGLE  MISSION  (SORTIE) 

18  VICTORIES 

MAJOR  ERICH  RUDORFFER 

6 NOVEMBER  IMl 

MOST  KILLS  SCORED  ON  THE  WESTERN  (INCLUDES 
MEDITERRANEAN)  FRONT 

13  VICTORIES 

CAPTAIN  HANS-JOACHIM  MARSEILLE 
MOST  KILU  SCORED  ON  THE  RUSSIAN  FRONT 

158  VICTORIES 

MAJOR  ERICH  HARTMANN 
BEST  KILL  AVERAGE  PER  SORTIE  FLOWN  (DAY 
FIGHTERS) 

LIEUTENANT  GUENTHER  SCHEEL  70  MISSIONS 

352  VICTORIES 

71  VICTORIES 

TOP  FIGHTER  ACE  FOR  NUMBER  OF  FOUR-ENGINED 
AIRCRAFT  SHOT  DOWN  (DAY  FIGHTERS) 

(RUSSIAN  FRONT) 

LIEUTENANT  HERBERT  ROLLWAGE 
TOP  FOUR-ENGINE  KILLER  (NIGHT  FIGHTERS) 

102  VICTORIES 
(44  OF  THEM  FOUR- 
MOTOR  BOMBERS) 

MAJOR  HEINZ  SCHNAUFER 
TOP  JET  ACE  (ME-262) 

121  VICTORIES 
(MOSTLY  FOUR- 
ENGINE) 

MAJOR  HEINZ  BAER 

16  VICTORIES 

FIGURE  3.1-6  "TOPS”  AND  "FIRSTS"  FOR  LUFTWAFFE 
PILOTS  IN  WORLD  WAR  II  (Adapted  from  Constable  and 
Toliver,  1968) 


the  British  in  North  Africa  without  ever  being 
reported  downed  (Constable  and  Toliver,  1968; 

Sims,  1967).  If  we  were  to  assume  equal  proba- 
bilities tf  obtaining  a kill  or  being  shot  down 
(which  is  hardly  a tenable  assumption  in  light  of 
Weiss'  [1966]  findings),  this  achievement  would 
have  a probability  of  occurrence  of  (1/2)150. 

Figure  3.1-8  shows  the  kill  records  of  800 
U.S.  Air  Force  F-86  pilots  against  MIG-15  opponents 
in  Korea.  Again  we  see  a relatively  small  number 
of  pilots  achieving  the  lion's  share  of  the  kills. 
Could  this  distribution  have  occurred  by  chance? 

The  overall  kill  statistics  from  Korea  were 
examined  to  see  if  they  could  be  "explained"  by 
chance.  Figure  3.1-9  summarizes  the  kill  ratios 
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NAME 

RANK 

VICTORIES 

HARTMANN,  ERICH 

MAJ. 

352 

BARKHORN,  GERHARD 

MAJ. 

301 

RALL, GUENTHER 

MAJ. 

275 

KITTEL,  OTTO 

1ST.  LT. 

267 

NOWOTNY,  WALTER 

MAJ. 

258 

BATZ,  WILHELM 

MAJ. 

237 

RUDORFFER,  ERICH 

MAJ. 

222 

BAER,  HEINRICH 

LT.  COL. 

220 

GRAF,  HERMANN 

COL 

212 

EHRLER,  HEINRICH 

MAJ. 

209 

WEISSENBERGER,  THEODOR 

MAJ. 

208 

PHILIPP,  HANS 

LT.  COL. 

206 

SCHUCK,  WALTER 

1ST  LT. 

206 

HAFNER,  ANTON 

1ST  LT. 

204 

LIPFERT,  HELMUT 

CAPT. 

203 

2 (PILOTS) 

190-199 

4 

180-189 

6 

170-179 

2 

160  - 169 

6 

150-159 

4 

140  - 149 

18 

130  - 139 

14 

120  - 129 

15 

110-119 

21 

100-109 

FIGURE  3.1-7  THIS  FIGURE  SHOWS  THE  SCORES  OF  THE 
107  LUFTWAFFE  ACES  WITH  ONE  HUNDRED  OR  MORE 
AERIAL  VICTORIES  IN  WORLD  WAR  II.  THE  FIFTEEN 
PILOTS  WITH  200  OR  MORE  KILLS  ARE  LISTED  BY  NAME. 
TWO  PILOTS  SCORED  BETWEEN  190  AND  199  KILLS;  21 
PILOTS  SCORED  BETWEEN  100  AND  109  KILLS. 

(Adapted  from  Constable  and  Toliver,  1968) 
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FIGURE  3.1-8  THIS  FIGURE  SHOWS  KOREAN  WAR  MIG-IS 
KILLS  FOR  800  USAF  F-86  PILOTS  EACH  OF  WHOM  HAD 
AT  LEAST  25  COUNTER-AIR  MISSIONS  (Drawn  from  Statis- 
tical Kill  Summary  Shown  in  Torrance,  ^ ) 

which  were  evidenced  in  Korea  during  quarterly 
time  periods  from  July  1950  through  July  1953. 
When  only  F-86  action  is  examined,  however,  the 
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TIME  PERIOD 

ENEMY  AIRCRAR 
DESTROYED 

USAF  AIRCRAFT 
DESTROYED 

ROUNDED  RATID 
ENEMY  DEST/ 
USAF  DEST 

J'JL-SEPT  1950 

32 

5 

6/1 

OCT-OEC  1950 

17 

4 

4/1 

JAN-MAR  1951 

17 

4 

4/1 

APR-JUNE  1951 

40 

11 

4/1 

JULY-SEPT 1951 

30 

10 

3/1 

OCT-OEC  1951 

88 

31 

3/1 

JAN-MAR  1952 

87 

13 

7/1 

APR-JUNE  1952 

97 

18 

5/1 

JULY-SEPT  1952 

116 

15 

8/1 

OCT-OEC  1952 

83 

13 

6./1 

JAN-MAR  1952 

98 

8 

12/1 

APR-JUNE  1952 

163 

5 

33,71. 

JULY  1953 

32 

2 

16/1 

TOTAL 

900  1 

139 

7/1 

about  200,  it  might  appear  that  chance  could  be 
used  to  explain  these  kill  records.  However,  when 
we  subjected  the  Air  Forces'  2.5  to  1 kill  ratio  to 
statistical  analysis  (using  131  enemy  destroyed  as 
a base)  we  find  that  the  chance  "explanation"  can 
be  rejected  with  considerable  confidence  (Chi  square 
and  simple  binomial  expansion  were  used,  see  Appen- 
dix 3. A. 2). 

We  were  able  to  gaiher  some  pilot  opinion  data 
concerning  the  issue  of  chance  and  luck.  As  part 
of  the  pilot  questionnaire,  we  asked  the  pilots  the 
question  shown  in  Figure  ;.1-10.  The  histogram  in 
Figure  3.1-10  shows  the  pilot  responses  to  this 
question.  Unfortunately,  the  way  we  presented  the 


FIGURE  3.1-9  USAF  CLAIMS/KILLS  AND  LOSSES  IN 
KOREAN  WAR  AIR-TO-AIR  COMBAT  (Adapted  from 
Bilikam  and  Frick,  1970) 

overall  kill  rate  proves  to  be  closer  to  10  to  1 
than  the  7 to  1 summary  rate  shown  for  all  air 
contat  in  Korea.  According  to  the  official  Air 
Force  history  of  the  air  war  in  Korea: 


"In  aerial  combat  Sabre  pilots  claimed  to 
have  destroyed  810  enemy  planes,  including 
792  MIG-15  fighters.  In  air-to-air  combat 
the  Far  East  Air  Force  lost  a total  of  139 
aircraft,  including  78  Sabres.  The  Sabre 
pilots  thus  maintained  a ten-to-one  margin 
of  victory  over  the  MIG-15  jet  fighters  - 
the  best  planes  which  the  Communists 
displayed  in  action  in  Korea."  iFutrell, 
1961,  p.  649) 


Using  the  MIG-15  and  Sabre  kill  data  (792  MIG 
kills  versus  78  Sabres),  we  conducted  two  conven- 
tional statistical  operations  (Chi-square  and  a 
simple  binomial  expansion  - see  Appendix  3.A.1)  to 
determine  if  the  chance  "explanation"  could  be 
rejected.  Both  statistical  procedures  indicate 
that  we  can  very  confidently  rule  chance  out  as  an 
explanation  of  the  outcome  of  the  Korean  air  war 
battle  between  Sabre  and  MI6-15. 

Inasmuch  as  the  highest  scoring  Air  Force  ace 
in  Southeast  Asia  claimed  only  six  kills,  and  since 
the  total  number  of  kills  by  both  services  was  only 


THE  RECORDS  OF  AIR-TO-AIR  COMBAT  FROM  WORLD  WAR  I TO  THE  PRESENT 
INDICATE  THAT  ONLY  A RELATIVELY  SMALL  PERCENTAGE  OF  PILOTS 
(PERHAPS  S TO  10%)  ARE  GETTING  THE  LIONS  SHARE  OF  KILLS.  ASIDE  FROM 
THE  ISSUE  OF  OPPORTUNITY  TO  ENGAGE  THE  ENEMY,  IS  THIS  A RESULT  OF 
CHANCE  OR  LUCK? 

60 1“ 


PERCENT 

OF 

PILOTS 


STRONGLY  AGREE 
AGREE 


DISAGREE  STRONGLY 
DISAGREE 


FIGURE  3.H0  THIS  FIGURE  SHOWS  PILOT  OPINION  CON- 
CERNING CHANCE  AND  LUCK  AS  THEY  RELATE  TO  AIR 
KILLS 

question  appears  to  us  now  to  be  vague.  Addition- 
ally, it  would  appear  that  some  of  the  pilots, 
recently  conditioned  by  the  Southeast  Asian  experi- 
ence, may  have  also  misinterpreted  the  question. 
About  all  we  can  say  is  that  the  clear  majority 
of  pilots  disagree  that  air  kills  are  a matter  of 
chance  or  luck. 
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3.1.3  Luck  - Luck  is  used  in  the  sense  of 
living  through  potentially  catastrophic  combat 
incidents,  not  so  much  by  positive  action,  but  by 
fortuity.  Any  number  of  anecdotal  incidents  have 
been  reported  by  Allied  and  Axis  pilots  of  World 
War  II  attesting  to  this  phenomenon.  Both  Sakai, 
the  highest  scoring  Japanese  pilot  to  survive  the 
war  (64  kills),  and  Hartmann,  the  highest  scoring 
German  pilot  (352  kills),  admit  that  by  all  rights 
they  should  have  been  killed  in  their  very  first 
combats  (Sakai,  1958;  Toliver  and  Constable,  1970). 
What  is  clear  from  World  War  II  is  that  early  combat 
engagements  resulted  in  very  high  pilot  attrition. 

It  seems  assured  that  many  potential  aces  are  lost 
during  that  period  because  of  their  inexperience, 
iln  a well  known  article,  Weiss  (1966)  has  presented 
data  which  give  a very  grim  picture  of  a fledgling 
pilot's  chances  of  surviving  his  first  few  decisive 
combat  enagements.  Novices  are  very  poor  risks, 
indeed,  and  have  a poor  chance  of  "surviving  even 
their  first  encounter"  (Weiss,  1966).  Significant- 
ly, those  pilots  who  survive  their  first  few  (5  to 
8)  decisive  encounters  then  evidence  a remarkably 
high  probability  of  surviving  subsequent  decisive 
encounters  (about  a .98  chance  of  survival).® 


some  remarkable  statistics  with  regard  to  kill 
ratio  (i.e.,  number  of  kills:  number  of  times  shot 
down).  A sampling  is  shown  in  Figure  3.1-11. 
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PILOT 

VICTORIES 

MODIFIED 
KILL  RATIO 

MAJ.  ERICH  HARTMANN 

352 

20:1 

MAJ.  GERHARD  BARKHORN 

301 

33:1 

CAPT.HANS-JOACHIM  MARSEILLE 

158 

150:0 

CAPT.  HELMUT  LIPFERT 

206 

13:1 

MAJ.  ERICH  RUDOFFER 

222 

10:1 

MAJ.  GEORGE  EBER 

36 

2:1 

OBLT  KURT  WELTER 

33 

1.5:1 

FIGURE  3.1-11  THE  WORLD  WAR  II  RECORDS  OF  SELECTED 
GERMAN  FIGHTER  PILOTS  USED  TO  ILLUSTRATE  THE 
KILL  RATIO  CONCEPT  (Drawn  from  Sims.  1951  and  Constable 
and  Toliver,  1968) 

Erich  Hartmann,  Germany's  top  scorer,  while 
achieving  352  victories,  was  himself  forced  down 
some  18  times,  roughly  a 20:1  kill  ratio.®  The 
largely  unheralded  Gerhard  Barkhorn  achieved  301 
victories  against  the  Russians  while  being  forced 
down  about  nine  times.  We  have  already  mentioned 
Marseille,  Germany's  top  scorer  against  the  British, 
who  shot  down  150  of  his  opponents  in  North  Africa 
without  being  downed.'® 


Two  important  points  should  be  made  with 
regard  to  these  concepts.  If  we  send  pilots  to 
combat  without  adequate,  specialized,  air-to-air 
combat  training  against  an  opponent  with  good 
fliers,  then  we  must  anticipate  high  attrition, 
poor  combat  effectiveness,  or  both,  to  occur.  If, 
however,  Weiss'  analysis  is  correct  and  we  can 
select  and  train  our  pilots  for  high  air-to-air 
ability,  then  we  can  expect  to  obtain  high  surviva- 
bility and  sustain  exceedingly  high  kill  ratios 
against  any  opponent  who  does  not  have  an  equally 
effective  selection,  training,  and  pilot  management 
system. 

Certainly,  some  luck  is  involved  in  combat 
effectiveness  scores.  The  only  way  that  we  can 
sensibly  explain  the  kill  statistics  coming  out 
of  World  War  II  (particularly  for  the  Luftwaffe) 
is  to  invoke  the  notion  of  kill  ratio  and  luck. 

The  German  fighter  pilots  of  World  War  II  produced 
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Two  other  high  scorers  present  interesting 
kill  ratio  statistics.  Helmut  Liofert,  flying 
against  the  Russians,  scored  203  victories  but  was 
shot  down  15  times  (13  by  ground  fire).  Erich 
Rudoffer,  who  divided  his  222  kills  between  East 
and  West,  was  shot  down  16  times  and  forced  to 
bail  out  another  9 times  for  a kill  ratio  of  about 
10:1  (Toliver  and  Constable,  1970). 


®The  Weiss  data  are  treated  in  more  detail  in 
Section  3.1.4. 

®According  to  Hartmann's  biographers  (Toliver 
and  Constable,  1970),  16  of  the  18  times  that  he 
was  forced  down  resulted  from  damaoe  to  his  plane 
caused  by  exploding  Russian  aircraft  that  he  was 
attacking. 

'®Interestingly , a large  number  of  Germany's  top 
scoring  pilots  did,  in  fact,  survive  the  war.  Both 
scorers  with  over  300  kills  (Hartmann  and  Barkhorn) 
are  among  this  group  and  played  significant  roles 
in  the  rebuilding  of  the  Luftwaffe.  Marseille  died 
during  the  war  in  a freak  air  accident  in  North 
Africa. 
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All  of  these  high  scoring  German  pilots  demon- 
strated kill  ratios  of  10:1  or  better  with  Hartmann 
exhibiting  about  a 20:1  ratio;  and  some,  Marseille 
(150:0)  for  example,  demonstrating  astonishingly 
high  kill  ratios.  Some  pilots  achieved  high  kill 
ratios  which,  when  augmented  by  luck,  resulted  in 
high  scores,  that  is,  high  combat  effectiveness. 

Pilots  at  the  end  of  the  kill  ratio  spectrum 
also  achieved  remarkable  records.  For  example, 
Germany's  George  Eber,  who  demonstrated  a 2:1  kill 
ratio,  downed  jl6  bombers  but  was  shot  down  17  times 
and  wounded  on  12  occasions  (he  survived  the  war). 
Finally,  one  more  German  pilot  who  pushed  his  luck 
was  Kurt  Welter  who  finished  the  war  with  33  kills 
(22  of  them  were  bombers).  On  his  first  11  sorties, 
he  scored  14  kills  but  was  shot  down  9 times,  a 
kill  ratio  of  about  1.5:1. 

\ Pilot  lore  can  be  used  to  support  the  opinion 
that  pilots,  in  general,  acknowledge  some  element 
of  luck  in  living  through  aviation  incidents,  par- 
ticularly those  which  are  clearly  out  of  their 
individual  control  - "every  safe  landing  is  a 
good  landing." 

While  incidents  of  luck  (surviving  to  fight 
again)  can  be  quoted  from  Southeast  Asia  as  well  as 
Korea  (remember  the  famous  photo  of  America's  triple 
ace,  Joe  McDonnell,  being  rescued  from  the  sea  by 
helicopter,  following  a forced  landing?),  it  is  not 
really  "required"  in  either  case. 

Because  of  the  "relatively"  small  number  of 
high  scoring  pilots  in  Korea,  and  particularly  in 
Southeast  Asia,  the  concept  of  luck  does  not  "have 
to  be  invoked." 

3.1.4  Survival  of  the  Fittest  or  Learning/ 
Experience?^ ' Weiss  (1966)  whom  we  have  already 
mentioned,  was  also  struck  by  the  fact  that  it  was 
the  relative  few  who  are  doing  the  overwhelming 
amount  of  damage  to  the  enemy.  He  hypothesized 
that  fighter  force  strength  is  related  to  the  per- 
formance of  a few  top  pilots  rather  than  the  size  of 
the  force. 


Weiss-  (1966)  developed  his  thesis  by  summar- 
izing empirical  data  on  the  probability  of  being 
killed  in  a decisive  engagement  from  large  sample 
statistics  from  two  wars;  Richtofen's  Jagdgeschwa- 
der'^  No.  1,  and  American  pilots  serving  with  the 
French  (including  the  Lafayette  Escadrille)  in 
World  War  I,  and  Jagdgescbwader  JG  26  in  World 
War  II.  The  data  are  shown  in  Figure  3.1-12. 


FIGURE  3.1-12  THIS  FIGURE  SHOWS  FIGHTER  PILOT  LOSS  RATE 
VS  KILL  SCORE  FOR  THREE  LARGE  FIGHTER  GROUPS. 
IMPORTANTLY,  THESE  DATA  SHOW  ONLY  THE  OUTCOME 
OF  DECISIVE  ENCOUNTERS  (Drawn  from  Weiss,  1966) 

To  WJiss: 

"The  initial  almost  vertical  drop  in  proba- 
bility of  being  killed  between  decisive 
combats  one  and  five  was  completely 
unexpected. 


"We  found  a consensus  of  belief  that  both  sur- 
vival of  the  fittest  and  experience  are  important 
factors.  The  reader  should  not  dismiss  the  "con- 
sensus of  the  data"  because  of  "exceptions  to  the 
rule."  For  example,  one  ace  (J.  F.  Sutherland; 
Personal  Communication)  reported  that  one  of  his 
fellow  Navy  pilots  who  had  gone  through  an  exhaus- 
tive pre-World  War  II  "selection"  process,  and  was 
an  exceptionally  skilled  aerobatic  pilot  (i.e., 

"the  fittest")  was  killed  in  his  very  first  combat. 
On  the  other  hand,  we  have  seen  inexperienced  pilots 
score  big  on  their  first  combat  mission. 

'^Weiss  (1966)  defines  chance  as  a .5  probabili- 
ty of  winning  or  losing  a decisive  air-to-air  en- 
counter. Jagdgescbwader  is  the  German  word  for 
Fighter  Wing  and  is  abbreviated  as  JG.  These  units 
were  usually  made  up  of  from  108  to  144  aircraft. 
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"The  value  of  about  0.02  [i.e.,  a two  per- 
cent chance  of  being  killed  in  any  decisive 
engagement]  in  the  range  10  - 30  [decisive 
encounters]  is  consistent  with  similarly 
computed  values  for  American  aces  in  World 
War  II  and  Korea  which  fell  in  the  range 
of  0.01  to  0.03." 

Values  in  the  same  range  are  also  shown  by 
Weiss  in  Figure  3.1-13  except  for  German  aces  with 
between  31  and  197  kills;  for  these  pilots,  the 
probability  of  being  killed  in  any  decisive  engage- 
ment is  .009. 
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PROBABILITY  OF 

SERVICE 

RANGE  OF 

BEING  KILLED 

SCORES 

IN  ANY  DECISIVE 

ENGAGEMENT 

UNITED  STATES  'SrOPE 

10-28 

0.015 

UNITED  KINGDOM  - RAF 

20-38 

0J24 

GERMANY  - JG-26 

10-30 

03118 

31-197 

0.009 

FIGURE  3.1-13  THIS  FIGURE  SHOWS  THE  EMPIRICAL 
PROBABILITY  OF  BEING  KILLED  IN  ACTION  AS  A 
FUNCTION  OF  NATION  AND  RANGE  OF  SCORES  (See 
Text)  (Taken  from  Weiss,  1966) 

A quick  analysis  on  a statistical  summary  of 
World  War  II  Allied  aces  prepared  by  Hess  (1968) 
indicated  that  aces  with  five  or  six  kills  had  a 
.032  probability  of  being  killed  in  subsequent 
decisive  engagements  while  aces  with  15  or  more 
kills  had  a .007  probability  of  being  killed  in 
subsequent  decisive  encounters  (see  Figure  3.1-14). 
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PILOTS  WITH 
GIVEN  NUMBER 
OF  KILLS 

NUMBER 

OF 

PILOTS 

NUMBER 

OF 

PILOTS 

KIA 

PERCENT 
OF  PILOTS 
KIA 

TOTAL  NUMBER 
OF  DECISIVE 
ENGAGEMENTS 
FOR  THESE 
PILOT  GROUPS 

PERCENT  OF 
PILOTS  KIA 
PER  DECISIVE 
ENGAGEICNT 

S OR  6 KILLS 

255 

66 

26*. 

2043 

3.2^ 

15  OR  MORE 
KILLS 

88 

12 

13.7’. 

1743 

0.7% 

FIGURE  3.1-14  THIS  FIGURE  SHOWS  THE  DIFFERENCE  IN 
SURVIVAL  FOR  TWO  GROUPS  OF  ALLIED  PILOTS  IN  WORLD 
WAR  II;  SEE  TEXT  (Drawn  from  a Statistical  Summary  of  the 
Records  of  Allied  Pilots,  Hess,  1968) 


In  accounting  for  these  data,  Weiss  (1956) 
favored  survival  of  the  fittest  rather  than  learninn 

"An  improvement  factor  of  twenty  in  five 
'trials  by  combat'  seems  less  likely  to  the 
writer  [Weiss]  than  the  hypothesis  that.  . . 
[Figure  3.1-12].  . . represents  the  survival 
of  the  fittest. " 

Weiss  (1966)  developed  a model  to  estimate  the 
impact  of  being  able  to  send  only  "Hawks"  (i.e., 
good  pilots;  potential  aces)  to  battle.  Several 
assumptions  were  made  - pilots  can  be  categorized 
as  either  Hawks  or  Doves;  Hawks,  not  identifiable 
before  combat,  represent  ten  percent  of  replacement 
pilots;  air  combat  engagements  are  one-on-one;  the 
probability  of  having  Hawks,  Doves,  or  both,  in 
each  combat  engagement  is  proportional  to  their 
representation  in  the  two  forces;  Hawks  always  win 
against  Doves,  Hawks  are  equivalent,  and  no  loss 
results  from  combat  between  Doves;  aircraft 
and  pilots  are  replaced  as  they  are  lost  and  forces 
are  equal;  and  pilots  can  survive  aircraft  losses 
with  certain  specified  probabilities.  Based  upon 
these  assumptions,  Weiss  concluded: 

"If  the  precombat  traininci  and  screening 
process  delivers  only  'Hawks'  to  one  side, 
that  side  may  have  a 10:1  sustained 
exchange  ratio,  at  all  times." 

The  combat  kills  and  attrition  data  presented 
by  Weiss  (1966)  have  been  used  by  other  analysts  in 
developing  "position  papers"  concerning  the  effect 
of  learning  in  achieving  air  combat  kills.  For 
example,  Bilikam  and  Frick  (1970),  operations 
analysts  in  the  Air  Force's  Aeronautical  Systems 
Division,  produced  a preliminary  paper  aimed  at 
".  . . establishing  whether  or  not  combat  data 
from  World  War  II,  Korea,  and  SEA  showed  promise 
of  establishing  the  existence  of  a learning  effect 
in  pilots  who  are  continually  enqaned  in  air-to-air 
combat."  While  their  preliminary  report  concluded 
that  the  ".  . . evidence  was  inconclusive.  . 
they  make  some  observations  which  are  worth  noting. 

Using  descriptive  statistical  summaries  by 
Futrell  (1960)  on  the  air  war  in  Korea,  Bilikam 


MDC  E1634  • 29  APRIL  1977 


3-11 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


MCOOMMCLL  OOUGi.J*S 


/ 


coiv^o#r A r#o  AT 


Frick  (1970)  found  some  suggestion  of  a learning 
phenomenon  in  that,  . . 68  percent  of  the  pilots 
who  destroyed  MlGs  were  over  28  years  old,  and  that 
this  was  significantly  greater  than  the  age  of  the 
overall  population  of  pilots."  Additionally,  they 
use  Korean  War  statistics  (see  Figure  3.1-9), 
which  summarize  the  results  of  air-to-air  encoun- 
ters, to  show  a trend  toward  U.S.  improvement  in 
kill  ratio’^  which  they  account  for  by  several 
alternative  explanations:  *'* 

"One  could  argue  that  the  Korean  War  data, 
which  shows  a trend  towards  increasing  USAF 
superiority,  would  support  the  hypothesis 
that  a learning  effect  is  present.  However, 
one  could  also  have  such  a trend  if  "survival 
of  the  fittest"  were  the  predominant  effect. 
Such  an  effect  would  cause  an  enrichment  of 
the  population  of  good  pilots  as  time  elapsed 
which  would  mean  that  combat  scores  of  the 
pilot  population  as  a whole  would  get  better. 

"To  fully  test  the  hypothesis  of  a learning 
effect  in  air-to-air  combat  will  probably 
involve  a two-fold  approach.  One  would  be 
analyses  of  combat  data  on  individual  pilots 
and  the  other  would  be  to  test  for  a learn- 
ing effect  under  controlled  experimental 
conditions.  This  latter  approach  is  neces- 
sary in  order  to  have  subjects  remain  "alive" 
to  determine  if  they  gained  experience  from 
the  previous  encounter. 

"One's  intuition  suggests  that  probably 
both  effects,  survival-of-the-fittest  due 
to  innate  skills  and  learning  by  exposure 
to  repeated  combats,  are  present.  There  is 
also  a third  effect  which  comes  to  mind, 
and  that  is,  the  interaction  with  enemy 
skill  level,  and  whether  that  skill  level 
changes  with  time.  This  additional  con- 
sideration is  an  argument  against  relying 
exclusively  on  combat  data  to  test  the 
hypothesis  ot  learning,  because  there  are 
so  many  uncontrolled  factors  present:  one 
does  not  really  know  what  is  causing  the 
variations  in  fraction  of  pilots  surviving. 
Controlled  laboratory  conditions,  i.e.,  sim- 
ulation, may  be  the  only  answer."  (pp.4-5) 


This  observation  by  Bilikam  and  Frick,  in  1970, 
was  well  taken.  Today,  however,  they  might  well 
add  controlled  air  condiat  maneuvering  ranges  to 
the  list  of  potential  (testing)  tools  that  might 
be  used  to  gain  insight  into  these  problems. 


In-cockpit  experience  (undoubtedly  confounded 
with  flight  position-opportunity)  is  evidenced  in 
Southeast  Asia,  as  was  the  case  in  Korea.  For 
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example,  Anderson  (1972)  has  reported  that  12  out 
of  13  MIG  kills  in  Vietnam  were  accomplished  by 
pilots  with  an  average  of  2,200  hours  of  like  air- 
craft background  and  with  an  average  age  of  35 
years.  Also,  recently  declassified  evidence  from 
the  Red  Baron  reports  (deLeon,  1977)  indicates, 
once  again,  that  during  at  least  one  phase  of  the 
war,  cockpit  experience  is  positively  related  to 
kills. 

However,  the  most  dramatic  evidence  of  the 
effect  of  specialized  air-to-air  training  (learning/ 
experience)  comes  from  Navy  pilot  kill  records  in 
Southeast  Asia.  Prior  to  the  introduction  of  the 
Navy’s  Top  Gun  school  where  pilots  flew  against 
dissimilar  aggressor  aircraft,  their  kill  ratio 
was  2.5  to  1;  after  Top  Gun  the  kill  ratio  jumped 
to  12.5  to  1 (deLeon,  1977).  While  this  improve- 
ment may  be  due  to  selection  practices  of  sending 
only  the  "better"  pilots  to  Top  Gun,  or  Indeed  to 
changes  in  the  air  war  itself,  it  is  usually  seen 
as  evidence  for  the  efficacy  of  this  type  of  spe- 
cialized training. 

It  is  just  common  sense  that  highly  relevant 
training  in  an  air  combat  surrogate  ("give  the  pilot 
his  first  eight  encounters  where  he  won't  be  killed") 
will  help  pilot  effectiveness.  The  more  compelling 
issue  is  whether  that  training  will  be  sufficient  to 
produce  truly  combat  effective  pilots.  It  may 
be  that  this  (and  even  more  extensive)  training 
combined  with  the  improved  pilot  selection  protocols 
will  be  required. 

When  we  asked  some  of  the  Air  Force  pilot 
instructors'^  at  the  Air  Combat  Maneuvering  (Range) 
School  at  Nellis  AFB  about  this  issue,  they  reported 
that  . . . "New  pilots  in  the  advanced  program  who 


'^According  to  a summary  of  Gen.  Homeyer  (1974), 
no  such  significant  trend  was  evidenced  by  Air 
Force  pilots  in  Southeast  Asia. 

'‘'Futrell  (1961)  sees  the  dramatic  improvement 
in  kill  ratio  during  the  last  nine  months  of  the 
war  (see  Figure  3.1-9)  resulting  from  the  with- 
drawal of  Russian  pilots  from  the  air  war. 

'"Personal  communication. 
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do  well  in  their  first  flights  not  only  continue  to 
be  better  but,  in  fact,  generally  improve  their 
lead  over  the  other  pilots." 

It  is  appropriate  to  ask  what  the  pilots  them- 
selves feel  concerning  the  "survival  of  the  fittest" 
and  learning  issues.  Figure  3.1-15  indicates  the 
pilot  responses  to  our  questionnaire  concerning 
learning  and  survival  of  the  fittest.  The  histogram 
in  Figure  3.1-15A  indicates  that  most  of  the  pilots 
(86  percent)  agree  that  learning,  indeed,  does  take 
place  through  combat  experience.  The  accompanying 
histogram  (Figure  3.1-15B)  concerning  the  issue  of 
survival  of  the  fittest  indicates  that  the  clear 
majority  of  pilots  (53  percent)  agree  that  there 
is  also  a survival  of  the  fittest  phenomenon  going 
on. 

The  factors  which  chronically  make  analysis  of 


EVIDENCE  FRO*  WORLD  WAR  II  AND  LATER  CONFLICTS  INDICATES  THAT  A 
COMBAT  FIGHTER  PILOT’S  CHANCES  OF  SURVIVAL  ARE  DRAMATICALLY 
IMPROVED  IF  HE  SURVIVES  HIS  FIRST  FIVE  AIR-TO-AIR  ENCOUNTERS.  THIS 
IS  A REFLECTION  OF: 

A.  THE  PILOT'S  LEARNING  THROUGH  EXPERIENCE 


air-to-air  combat  kill  data  (regarding  U.S.  aviator 
qualities)  difficult  were  summarized  in  the  thorough 
study  of  these  issues,  by  Strawbridge  and  Kahn 
(1955). 

"All  fighter  pilots  were  not  equally  effec- 
tive in  Korean  combat.  Most  pilots  destroyed 
very  few  enemy  aircraft;  a few  pilots  destroyed 
many  aircraft.  These  differences  in  effective- 
ness were  partially  the  result  of  the  opera- 
tional and  tactical  situations  and  partially 
the  result  of  differences  in  individual  abil- 
ities among  the  pilots. 

"From  an  operational  viewpoint  the  older, 
higher  ranking  pilots  with  the  most  flying 
and  prior  combat  experience  were  chosen  to 
fly  as  flight  or  element  leaders  on  most 
of  their  counterair  missions  to  MiG  alley. 
Younger,  less  experienced  pilots  flew  propor- 
tionately more  missions  as  wingmen.  Conse- 
quently the  leaders  experienced  more  of  all 
phases  of  combat  and,  because  of  this  con- 
siderable opportunity,  scored  more  enemy 
kills.  Although  these  pilots  had  the  most 
opportunity  to  contact  the  enemy  there  is 
no  basis  for  believing  that  they  were  basic- 
ally any  more  effective  than  pilots  who 
were  chosen  less  often  to  fly  a lead  position. 
There  is  no  evidence  to  indicate  that  the 
pilots  who  experienced  15  or  more  encounters 
with  the  enemy  were  able  to  maneuver  into 
firing  position  or  fire  more  accurately 
than  pilots  who  experienced  fewer  encounters 
with  the  enemy.  Nor  is  there  any  evidence 
furnished  by  the  pre-pi  lot- training  tests 
that  discriminates  these  two  groups.  The 
Training  Command  would  consider  most  of  the 


B.  A ‘SURVIVAL  OF  THE  FITTEST"  PHENOMENON.  THE  POORER  PILOTS  ARE 
SHOT  DOWN 


agree  opinion  DISAGREE 

FIGURE  3.1-15  THIS  FIGURE  SHOWS  PILOT  ATTITUDE 
CONCERNING  LEARNING  AND  "SURVIVAL-OF-THE- 
FITTEST"  PHENOMENA  DURING  EARLY  COMBAT 
ENCOUNTERS 

pilots  who  flew  in  Korea  better  than  average 
risks  to  complete  the  training  program  suc- 
cessfully. 

"Among  those  pilots  who  had  sufficient  con- 
tact with  the  enemy  (15  or  more  encounters), 
considerable  variability  in  effectiveness 
is  noted.  Some  pilots  were  [very  good,  and 


I 
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were  able  to  convert  about  one-half  of  their 
encounters  into  kills  . . . some  pilots  were 
poor  and  recorded  no  kills].  . . 

“Since  considerable  interest  is  attached  to 
understanding  the  basis  for  individual 
differences  in  combat  performance,  a number 
of  selected  non-combat  variables  have  been 
correlated  with  selected  combat  variables. 

These  correlations  suggested  that  age,  rank, 
and  flying  experience  were  the  significant 
variables  influencing  a pilot's  flight 
assignment  as  leader.  These  leaders  showed 
marked  degrees  of  Physical  Aggressiveness 
and  Risk  and  Strategy  as  measured  by  Torrance's 
[1957]  "Life  Experience"  scales.  However, 
there  are  indications  that  these  more  exper- 
ienced pilots  were  somewhat  more  cautious  than 
younger,  less  experienced  men.  The  amount  of 
jet  flying  time  appears  to  be  one  of  the 
strongest  variables  influencing  combat  effec- 
tiveness. It  is  presumed  that  the  young, 
aggressive  pilot  well  trained  in  jet  aircraft 
would  be  the  most  effective  pilot  in  this 
type  of  combat.  Evidence  is  offered  which 
suggests  that  several  of  Torrance's  scales 
show  promise  of  having  predictive  value  in 
measuring  combat  effectiveness.  Physical 
Aggressiveness  and  Parental  Striving  are 
shown  to  influence  combat  effectiveness. 
Testing  the  Limits,  Childhood  Neurotic 
Behavior,  and  Social  Participation  also 
show  promise  in  this  direction. 

"The  use  of  pre-pilot-training  tests  shows 
no  promise  as  predictors  of  combat  effec- 
tiveness. While  these  tests  are  valid  in 
predicting  pass-fail  in  the  pilot  training 
program,  they  apparently  do  not  measure 
those  qualities  necessary  for  success  in 
combat. 

"In  the  aggregate,  these  points  all  indicate 
that  the  qualities  necessary  for  success  in 
combat  are  not  well  understood.  While 
flying  experience,  particularly  jet  flying 
time,  plays  a role,  superior  combat  effec- 
tiveness is  founded  on  much  more  basic 
mechanisms,  as  implied  in  Torrance's  scales. 

It  seems  evident  that  reliable  prediction 
of  combat  effectiveness  must  await  the 
development  of  much  more  subtle  psycholog- 
ical and  physiological  tests."  (pp.  71-72) 


We've  underlined  the  last  few  words  of  Straw- 
bridge  and  Kahn's  (1955)  summary  because  we  would 
make  an  important  distinction  - we  don't  think  the 
tests  will  be  more  subtle,  but  rather,  they  should 
be  based  upon  selection  tests  of  what  can  reasonably 
be  presumed  to  underlie  air  combat  effectiveness. 
Furthermore,  these  tests  should  be  comprehensive 
(i.e.,  test  all  of  the  factors  which  are  considered 
important)  and,  should  be  designed  to  be  more 


powerful  and  demanding  so  that  they  have  the  cap- 
ability of  discriminating  among  the  pilot  candidates 
who  can  "pass"  the  various  components  of  selection 
tests  that  are  currently  employed. 

Before  we  begin  our  systematic  search  for  the 
factors  which  underlie  coirbat  effectiveness,  a 
brief  review  of  what  some  famous  soldiers  tell  us 
about  combat  effective  men  is  in  order  to  add  per- 
spective to  the  problem. 

3.1.5  What  Some  Famous  Soldiers  Tell  Us  about 
Combat  Effective  Men  - What  is  the  human  ingredient 
that  distinguishes  the  coward  from  the  gallant 
soldier,  the  combat  effective  from  the  ineffective, 
the  man  who  will  fight  from  the  man  who  will  not 
fight? 

S.  L.  A.  Marshall,  a World  War  I veteran,  and 
professional  military  historian  had  an  unparalleled 
opportunity  to  investigate  the  combat  effectiveness 
of  American  infantryman  of  World  War  II.  In  all. 
Marshall  (1947)  interviewed  some  400  companies  of 
infantry  both  in  Europe  and  the  South  Pacific.  His 
book.  Men  against  Fire,  published  shortly  after  the 
war,  is  a thoughtful  and  emxjtional  statement  of 
his  findings  and  opinions. 

We  remember  Marshall's  dramatic  revelation 
that  in  any  given  engagement  only  about  20  percent 
of  American  infantrymen  fire  their  weapons  effec- 
tively. But  why  do  men  fight?  If  Marshall  has  one 
answer,  it  is  for  self-respect. 

Perhaps  this  has  been  the  reason  throughout 
American  history.  A well-quoted  incident  from  the 
Civil  War  hits  at  the  same  point.  A company  of 
Confederate  infantry  marching  into  battle  put  a 
rabbit  into  flight.  From  the  ranks,  an  anonymous 
soldier  cried,  "Go  ahead  and  run,  if  1 didn't  have 
a reputation  to  live  up  to  I'd  run  too." 

General  George  S.  Patton,  in  defending  the 
need  for  the  U.S.  Military  Academy,  said  "We  need 
the  time  and  kind  of  training  the  Point  provides 
to  make  a man  more  afraid  of  his  conscience  than 
he  is  of  enemy  bullets."  (Blumenson,  1972). 
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World  War  II  Luftwaffe  Fighter  Conmander 
General  Adolph  Galland  put  it  this  way,  . .only 
the  spirit  of  attack  born  in  a brave  heart  will 
bring  success  to  any  fighter  aircraft  no  matter 
how  highly  developed  it  may  be."  (Galland,  1954). 


While  different  authors  put  it  in  different 
words  - character,  self-respect,  conscience,  the 
brave  heart  - their  comments  are  particularly 
relevant  for  today's  military.**’  Since  our  mili- 
tary forces  must  be  prepared  to  fight  with  fewer, 
higher  cost  weapons  systens,  it  becomes  increasingly 
important  that  we  be  able  to  identify  those  men  who 
will  fight  and  fight  effectively. 


How  does  one  go  about  identifying  men  who  will 
prove  themselves  in  combat?  Could  anyone  have  pre- 
dicted that  an  uneducated  backwoodsman,  who  resisted 
induction  into  the  military  as  a conscientious  objec- 
tor, would  become  America's  most  celebrated  infan- 
tryman of  World  War  I?  What  characteristics  did 
the  poorly  educated,  rough  and  tumble,  Rickenbacker 
and  the  Baron  Von  Richthofen  have  in  common?  Is 
there  a common  denominator?'^ 


Edward  H.  Sims,  an  American  World  War  II 
fighter  pilot  turned  biographer,  in  his  book. 

The  Greatest  Aces  (1967)  asks  this  question  about 
the  top  aces  of  the  RAF,  the  Luftwaffe,  and  the 
USAAF; 

"What  about  the  pilots  themselves?  What  kind 
of  men  were  they,  and  are  they?  How  do  they 
vary  from  country  to  country  and  what  in  them 
made  them  stand  above  the  average  to  become 
the  highest-scoring  pilots  of  their  air 
forces?  There  is  no  standard  pattern  into 
which  one  can  fit  these  outstanding  fighter 
pilots.  They  vary  as  much,  in  personality, 
appearance  and  behavior,  as  other  individuals 
though  they  have  a comradeship  among  them- 
selves. All  are  alert:  one  doesn't  find  the 

dullard  among  them  — even  years  after  the 
war.  The  significant  difference  between  the 
top-scoring  'aces'  and  the  average  pilot 
might  have  manifested  itself  only  in  the  air  -- 
what  they  did  under  various  circumstances,  how 
they  did  it.  . . 

".  . . of  all  the  top  aces  of  the  war  he 
[Hartman]  is  the  greatest  enigma.  One  sus- 
pects that  somewhere  beneath  that  surface 
calm,  beneath  that  appearance  of  fitting  into 
the  average-pilot  mold,  there  bums  an  intense, 
determined  individual,  with  great  self- 
discipline  and  an  iron  will  . . ."  (p.  5) 


Sims,  the  writer,  is  expressing  an  underst-ind- 
able  frustration;  he  holds  the  conviction  that 
there  must  be  something  about  the  gallant  warrior 
that  sets  him  apart  . . . but,  for  him.  it  is  an 
elusive  factor  and  not  readily  apparent. 


Pilots,  military  historians,  biographers,  and 
research  scientists  have  all  touched  upon  this 
issue  from  their  own  particular  perspective.  Our 
approach  to  identifying  information  on  what  we 
know  about  the  characteristics  of  the  combat  effec- 
tive is  developed  in  the  following  subsections  (3.2 
through  3.6). 


3.1.6  Summary  - In  order  to  adequately  assess 
air-to-air  kill  records,  the  factor  of  opportunity 
(i.e.,  the  chance  to  engage  the  enemy)  needs  to  be 
controlled.  This  factor  necessarily  affects  the 
number  of  air  kills  obtained  by  an  individual  pilot. 
In  examining  air  war  kill  data  for  World  War  I and 
World  War  II,  it  was  found  that  the  German  and 
Japanese  pilots  had  a large  number  of  opportunities 
to  engage  the  enemy,  while  the  British  and  American 
pilots  had  limited  opportunities.  This  is  attribu- 
table to  different  management  procedures.  German 
and  Japanese  pilots  were  kept  on  constant  combat 
duty,  whereas  British  and  American  pilots  were 
placed  on  noncombat  tours  after  a specified  period 
of  time  or  number  of  combat  missions.  Similarly, 


**’The  reader  is  asked  to  have  some  indulgence  as 
we  develop  our  story.  The  critic  may  dismiss  us 
prematurely  if  he  demands  rigid  definition  of  terms 
too  early  on.  For  example,  if  we  defined  character 
as  having  a strong  sense  of  "right  and  wrong,"  our 
critic  might  well  dismiss  us  since  he  knows  of  a 
combat  effective  veteran  who  may  have  once  done 
something  "wrong."  He  establishes  very  little  if 
he  can  find  exceptions  to  the  general  case  beyond 
just  that  - that  he  has  found  an  exception  (a  white 
crowp . 

'’When  we  talk  about  "common  denominators"  we 
should  be  a bit  more  specific.  We  are  in  fact 
looking  for  attributes  which  are  commonly  (i.e., 
frequently)  shared  by  a substantial  number  of  com- 
bat effective  pilots.  This  is  not  to  say  that 
exceptions  to  any  profile  will  not  come  along  - 
they  certainly  have  before  - after  all,  we  have 
seen  ace  pilots  score  kills  who  were  missing  an 
eye  - Sakai,  Japan  (Sakai,  1958);  an  arm  - MacLach- 
lan,  Britain  (Hess,  1968);  a leg  - Rudel , German 
(Rudel,  1958);  and  both  leas  - Bader,  Britain  and 
Maresyev,  USSR  (Hess,  1968);  and  there  have  been 
female  ace  fighter  pilots  - Katia  Budanova  and 
Lilya  Litvak,  both  of  the  USSR  (Hess,  1968). 
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in  the  Korean  and  Southeast  Asian  conflicts, 

American  pilots  did  not  have  a large  number  of 
engagement  opportunities.  One  solution  to  this 
problem  is  to  use  a measure  suggested  by  Strawbridge 
and  Kahn  (1955),  number  of  kills  per  opportunity. 

In  evaluating  air  war  kill  data,  one  of  the 
immediate  questions  which  arises  is  whether  or  not 
reported  kill  records  can  be  accounted  for  by  chance/ 
luck.  Generally,  the  chance  explanation  can  be 
rejected.  For  example,  statistical  analyses  of  Air 
Force  kill  ratios  in  Korea  and  in  Southeast  Asia 
revealed  that  the  chance  explanation  can  be  ruled 
out  with  high  levels  of  certainty.  Pilot  opinion 
was  in  agreement.  When  pilots  were  asked  if  records 
of  air-to-air  conbat  from  World  War  I to  the  present 
are  due  to  chance,  71%  said  they  are  not. 

Finally,  one  of  the  most  surprising  findings 
resulting  from  the  evaluation  of  air  war  kill  data 
is  that  a small  percentage  of  pilots  have  been 
responsible  for  a large  percentage  of  kills,  i.e., 
approximately  five  percent  have  accounted  for 
forty  percent  of  the  kills.  Due  to  the  low  percen- 
tage of  pilots  in  this  category,  it  seems  that  a 
chance/luck  explanation  can  be  discounted  with  a 
reasonably  high  level  of  certainty.  Related  to 
this  is  the  finding  that  those  who  survive  their 
first  few  decisive  encounters  (five  to  eight)  have 
a very  high  probability  of  surviving  succeeding  ones. 
The  obvious  question  is  whether  this  phenomenon  is 
attributable  to  survival  of  the  fittest,  learning 
(experience),  or  both.  While  some  have  suggested 
that  the  observed  improvement  rate  is  too  extreme 
to  be  due  to  a learning  effect  (Weiss,  1966),  others 
have  argued  that  the  learning  explanation  cannot  be 
ruled  out  (Bilikam  and  Frick,  1970).  Additionally, 
pilot  opinion  supported  the  involvement  of  both 
survival  of  the  fittest  and  learning  in  this  pheno- 
menon. It  is  apparent  that  controlled  research 
using  simulators  or  air  combat  maneuvering  ranges 
is  required  to  answer  this  question. 
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3 . 2 SCIENTIFIC  STUDIES  OF  AVIATOR  COMBAT 
EFFECTIVENESS 

Research  on  aircrew  performance  in  combat  en- 
vironments has  been  very  limited  and,  necessarily, 
sporadic.  That  activity  which  has  occurred  has  not 
always  been  well  coordinated  nor  has  it  been  dis- 
tributed equally  among  the  various  services. 

Figure  3.2-1  lists  scientific  studies  of  aircrew 
performance  in  times  of  conflict.  The  studies  are 
grouped  by  branch  of  service  and  by  period  of  con- 
flict. Inspection  of  Figure  3.2-1  reveals  not  only 
a very  limited  number  of  studies  in  the  area,  but 
an  inconsistency  of  effort.  Major  efforts  were 
launched  by  both  the  Army  Air  Forces  and  the  Navy 
in  World  War  II,  and  a substantial  research  effort 
was  undertaken  by  the  Air  Force  in  Korea.  The 
series  of  "Red  Baron"  reports  which  examined  the 
air  war  in  Southeast  Asia,  while  valuable  for  other 
reasons,  is  limited  for  our  purposes  by  the  over- 
riding issue  of  opportunity  for  air  kills. 

A general  finding  which  emerges  from  this 
review  is  that  there  is  strong  precedent  for  the 
conduct  of  pilot  selection  research  in  the  combat 
arena.  This  research  was  performed  surprisingly 
well  in  both  World  War  II  and  Korea  considering  the 
short  lead  time.  Unfortunately,  with  the  close  of 
a conflict,  interest  in  developing  the  selection 
tools  which  would  be  useful  in  the  next  conflict 
wanes,  and  the  continuity  of  research  which  should 
be  present  is  lost. 

Because  training  criteria  have  been  more  read- 
ily available,  military  aviation  selection  research 
has  focused  on  selection  for  training  success,  not 
success  in  the  operational  environment.  The  prob- 
lem posed  by  this  research  orientation  will  be  dis- 
cussed below  when  the  criterion  issue  is  addressed. 

Although  the  number  of  studies  of  aircrew  per- 
formance in  the  combat  environment  is  limited, 
these  studies  do  allow  an  assessment  of  critical 
skills  and  individual  characteristics  which  have 
been  related  to  combat  performance.  These  rela- 
tionships, both  weak  and  strong,  provide  the  present 
researchers  a fertile  source  of  hypotheses  about 


the  makeup  of  the  combat  effective  aviator.  Fur- 
thermore, they  provide  a list  of  characteristics 
which  with  careful  evaluation,  and  properly  de- 
signed and  refined  test  instruments,  could  form 
the  basis  for  a fighter  pilot  selection  program. 

3.2.1  Predictor  Variable  and  Criterion 
Issues  - Two  interacting  basic  problems  must  be 
dealt  with  in  any  personnel  selection  research 
program.  These  problems  deal  with  the  selection 
of  predictor  variables  and  with  the  identification 
and  measurement  of  criteria.  The  predictors  are 
likely  to  be  performance  measures  on  tests  of 
various  kinds,  e.g.,  motor  skills,  aptitudes,  intel- 
ligence, personality,  special  skills.  For  fighter 
pilots,  number  of  air  kills  should  be  a good  cri- 
terion. Other,  less  satisfactory  criteria,  such 
as  how  well  the  pilot  was  liked  by  his  peers,  or 
how  well  he  does  in  pilot  training  might  also  be 
used. 

The  index  of  predictability  normally  used  in 
selection  research  is  the  validity  coefficient, 
which  relates  performance  on  some  predictor  vari- 
able to  performance  on  a criterion  measure.  The 
higher  the  validity  coefficient  (up  to  a ceiling 
of  1.0),  generally,  the  better  the  prediction.  If 
the  coefficient  falls  short  of  the  maximum,  it  can 
be  because  of  weakness  in  the  reliability  or  defi- 
nition of  either  predictor  or  criterion  measures. 
Criticism  of  the  predictor  measures  is  more  fre- 
quent in  the  testing  literature  than  criticism  of 
the  criterion  measures,  although  both  measures  are 
important  for  prediction.  For  example,  a researcher 
could  show  that  air  superiority  fighter  pilots  who 
had  attended  a particular  college  were  universally 
"liked"  by  their  peers  (i.e.,  have  demonstrated  a 
"validity"  coefficient  of  1.0).  While  the  statis- 
tical exercise  might  be  impressive,  nothing  of 
practical  value  exists  unless  being  liked  by  fellow 
pilots  is  a legitimate  criterion  of  combat  effec- 
tiveness. 

This  problem  of  criterion  definition  is  empir- 
ically demonstrated  in  an  early  I970’s  examination 
of  criterion  selection  in  our  colleges  and 
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FIGURE  3.M  AVIATION  COMBAT  STUDIES.  THESE  ARE  DOCUMENTS  WHICH  REPORT  WARTIME  AND  POSTWAR  RESEARCH 
EFFORTS  THAT  PERTAIN  TO  THE  COMBAT  EFFECTIVENESS  OF  PILOTS. 


universities.  (McClelland,  1973).  Though  polemical 
in  tone,  McClelland  justifiably  points  to  situations 
where  we  have  been  predicting  to  success  in  train- 
ing, not  in  the  real  world.  His  example,  below, 
makes  the  point  well . 

"1  took  the  top  eight  students  in  a class 
in  the  late  1940s  at  Wesleyan  University 
where  I was  teaching  - all  straight  A 
students  - and  contrasted  what  they  were 
doing  in  the  early  1960s  with  what  eight 
really  poor  students  were  doing  - all  of 
whom  were  getting  barely  passing  averages 
in  college  (C-  or  below).  To  my  great 
surprise,  I could  not  distinguish  the  two 
lists  of  men  15  - 18  years  later.  There 
were  lawyers,  doctors,  research  scientists, 
and  college  and  high  school  teachers  in  both 
groups.  The  only  difference  I noted  was 
that  those  with  better  grades  got  into 
better  law  or  medical  schools,  but  even 
with  this  supposed  advantage  they  did  not 
have  notably  more  successful  careers  as 
compared  with  the  poorer  students  who  had 
had  to  be  satisfied  with  "second-rate"  law 
and  medical  schools  at  the  outset." 

(McClelland,  1973,  p.  2) 

We  must  be  careful  in  assuming  that  those  who  do 
well  in  training  necessarily  will  go  on  to  perform 
well  in  the  operational  environment. 


In  light  of  the  limitations  imposed  by  the 
real  world  environment,  we  must  consider  carefully 
the  predictors  and  the  criteria  used  for  selecting 
fighter  pilots  for  the  air-to-air  role.  The 
remainder  of  Section  3.2  focuses  primarily  upon 
predictor  variables.  We  hope  to  isolate  those 
characteristics  and  critical  skills  which  can  be 
used  to  predict  fighter  pilot  combat  effective- 
ness. This  is  done  at  the  level  of  hypothesis 
generation,  and,  undoubtedly,  the  development  of 
specific  selection  instruments  will  be  required. 
The  criteria  cited  in  this  section  have  been  the 
closest  to  real  world  or  ultimate  criteria  of 
air-to-air  combat  performance. 


particular  author.  We  have  chosen  to  construct  a 
summary  of  what  has  been  done  by  analyzing  data 
from  various  sources  and  drawing  conclusions  based 
upon  both  the  composite  and  an  assessment  of  in- 
sights and  conclusions  offered  by  the  individual 
authors.  In  doing  this,  we  hope  to  develop  a 
coherent  picture  of  what  has  gone  before. 

The  reported  statistics  from  the  studies  are 
assembled  in  Figure  3.2-2.  Across  the  top  of  Fig- 
ure 3.2-2  are  the  criteria  that  have  been  used  by 
the  various  researchers.  Thirty-nine  distinct 
criteria  of  combat  effectiveness  have  been  used 
in  these  studies.  Objective  criteria  of  fighter 
pilot  performance  range  from  number  of  kills  and 
comparisons  of  aces  with  nonaces  to  administrative 
actions,  such  as  retention  in  the  fighter  program. 
Objective  measures  of  bomber  crew  performance  gen- 
erally consist  of  some  measure  of  bombing  accuracy. 
Subjective  measures  include  ratings  by  psycholo- 
gists, superiors,  and  peers.  As  individual  stud- 
ies are  discussed,  the  various  criteria  should 
become  clearer.  Along  the  left  margin  of  Figure 
3.2-2  are  the  various  characteristics  and  critical 
skills  which  have  been  used  as  predictor  variables. 
Most  cell  entries  are  correlations  between  a pre- 
dictor and  a criterion.  In  some  cases,  as  noted, 
other  statistics  such  as  t,  or  a critical  ratio 
are  included  to  reflect  the  relationship  between 
a predictor  and  a criterion.  A slash  indicates  a 
range  of  values.  Substantial  blank  spaces  are 
present  in  the  figure.  These  spaces  serve  to 
emphasize  the  sporadic  and  inconsistent  nature  of 
the  studies  dealing  with  combat  effectiveness. 

They  also  identify  areas  for  further  research,  as 
some  seemingly  reasonable  predictors  have  only 
been  validated  against  a single,  subjectively 
based  criterion. 


;v- 


3.2.2  Aviation  Combat  Data  - Relating  predic- 
tor variables  to  aviation  combat  success  has  too 
often  been  the  goal  rather  than  the  activity  of 
many  researchers.  Nevertheless,  our  literature 
search  has  revealed  several  studies  which  quanti- 
tatively report  the  relationships  between  numerous 
variables  and  combat  success  as  interpreted  by  the 
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Predictor  characteristics  have  been  sorted 
into  a tentative  taxonomy  of  characteristics  and 
critical  skills  making  up  11  major  selection  do- 
mains. No  preconceived  groupings  were  applied  to 
the  data.  These  categories  are  meaningful  as  work- 
ing hypotheses  developed  by  the  present  research 
team,  but  are  not  intended  to  be  exhaustive. 


FIGHTERS 


FIGURE  3.2-2  STATISTICAL  RELATIONSHIPS  BETWEEN  CRITERIA  OF  COMBAT  EFFECTIVENESS  AND  EXPERIMENTALLY  EVALUATED 
ALONG  THE  LEFTHAND  MARGIN).  INDIVIDUAL  ENTRIES  ARE  THE  STATISTIC  INDICATED  AT  THE  TOP  OF  EACH  COLUMN.  f 
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FIGURE  3.2-2  STATISTICAL  RELATIONSHIPS  BETWEEN  CRITERIA  OF  COMBAT  EFFECTIVENESS  AND  EXPERIMENTALLY  EVALUATEI 
ALONG  THE  LEFTHAND  MARGIN).  INDIVIDUAL  ENTRIES  ARE  THE  STATISTIC  INDICATED  AT  THE  TOP  OF  EACH  COLUMN.  (ContinuW 
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3.2.2. 1 World  Uar  1 1 Studies  - Before  World 
War  II  the  selection  of  pilots  was  based  upon  age, 
education,  and  a thorough  medical  examination 
(OuBois,  1947).  The  number  of  pilots  flowing 
through  the  pre-war  military  system  (the  total 
force  strength  was  under  1000  officers)  allowed 
that  limited  selection  approach  to  be  adequate. 
However,  the  requirement  in  World  War  II  to  fill 
more  cockpits  and  fill  them  quickly  demanded  im- 
proved procedures  for  pilot  selection.  With  the 
demand  for  improved  selection  and  training  of  pilots, 
the  Army  Air  Forces  (AAF)  Aviation  Psychology 
Program  was  established  in  June  of  1941.  That 
program  dealt  primarily  with  aircrew  selection 
and  training,  but  also  examined  personnel  problems 
in  other  AAF  settings.  From  the  Aviation  Psy- 
chology Program  work  a 19  volume  document  emerged 
reporting  all  phases  of  that  research  program.* 

The  portion  of  the  work  predicting  training  success 
is  described  in  Section  3.4  of  the  present  report. 

In  addition  to  predicting  success  in  training, 
the  Army  Air  Forces  Aviation  Psychology  Program 
was  specifically  tasked  with  discovering,  "... 
the  extent  to  which  known  individual  differences 
in  aptitudes  and  other  traits  are  reflected  in  the 
combat  effectiveness  of  air-crew  personnel," 

(Lepley,  1947,  p.  12).  Forced  to  gear  up  rapidly, 
the  research  team  started  with  tests  which  were 
develoced  for  predicting  training  success  and 
collected  data  on  four  types  of  criteria.  They 
were  objective  measures,  administrative  actions, 
direct  and  systematic  observations,  and  ratings 
based  on  general  impressions.  (The  fourth  category 
includes  the  criterion  used  by  the  Naval  Aviation 
researchers.)  The  four  classes  of  criteria  were 
selected  according  to  availability  and  apparent 
correspondence  with  the  ultimate  criterion,  objec- 
tively demonstrated  combat  effectiveness.  The 
objective  measures,  in  some  instances,  are  the  ulti- 
mate criterion  (as  in  enemy  kills),  but  even  these 
measures  were  subject  to  some  problems  since  the 
quality  of  records  was  degraded  because  of  the 
exigencies  of  the  combat  environment.  The  other 
criterion  measures,  even  as  intermediate  criteria, 
(see  Throndike,  1947,  1949)  were  collected  in  the 
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theater  of  operations,  and,  as  such,  should  reflect 
a better  approximation  of  the  ultimate  criterion. 
Despite  the  problems  encountered  in  this  work,  this 
research  program  far  exceeded,  in  scope,  data 
collection,  and  analysis,  other  pilot  selection 
research  efforts  which  were  conducted  during  World 
War  II. 


The  criterion  measures  for  the  Lepley  (1947) 
studies  were  retention  in  the  fighter  program, 
completing  a tour  versus  being  reclassified, 
commanders'  ratings  of  best  and  poorest  pilots, 

G-ratings^,  and  objective  measures  of  bombing  accur- 
acy. This  is  a broader  range  of  combat  criteria 
than  other  researchers  have  used.  Similarly,  the 
Air  Force  researchers  in  World  War  II  evaluated 
a very  broad  range  of  predictors.  Lepley  reports 
some  disappointment  in  the  magnitude  of  the 
validity  coefficients  obtained.  In  historical 
perspective,  however,  the  results  of  that  combat 
validation  program  are  profound,  both  in  terms  of 
the  groundwork  laid  for  later  personnel  research 
and  in  terms  of  some  specific  findings.  Certain  j 

of  the  validity  coefficients  were  impressive.  For  j 

example,  discrimination  reaction  time  correlated 
significantly  with  G-ratings  and  three  measures  of  i 

bombing  accuracy  (see  Figure  3.2-2).  I 

i 

i 

I 


*It  began  when  Col.  (Dr.)  John  C.  Flanagan  ' 

reported  for  duty  in  July  of  1941.  Dr.  Flanagan  | 

had,  as  a civilian,  been  the  Associate  Director 
of  the  New  York  based  Cooperative  Test  Service 
(DuBois,  1947).  Immediately,  he  drew  together  a 
highly  talented  group  of  experimental  psycholo- 
gists and  established  what  probably  was  the  most 
effective' appl ied  psychological  research  team  ever. 

Most  went  on  to  achieve  unusually  high  levels  of 
prominence  in  psychology.  Col.  Flanagan's  team 
leaders  were:  Sidney  W.  Bijou,  Clarence  W.  Brown, 

Launor  F.  Carter,  Stuart  W.  Cook,  Meredith  P. 

Crawford,  John  T.  Dailey,  Frederick  B.  Davis 
Walter  L.  Deemer,  Philip  H.  DuBois,  Paul  M.  Fitts, 

Edwin  E.  Ghiselli,  James  J.  Gibson,  J.  P.  Guilford, 

R.  N.  Hobbs,  A.  Pemberton  Johnson,  Edward  H.  Kemp, 

John  I.  Lacy,  William  H.  Lepley,  Arthur  W.  Melton, 

Neal  E.  Miller,  Richard  T.  Solenberger,  Robert  L. 

Thorndike,  Louis  B.  Ward,  and  Frederic  Wickert. 

Three  other  major  figures  in  the  total  effort  were 
Frank  Geldard  of  Hq.  Training  Command,  Lawrence 
Shaffer  of  Hq.  Redistribution  Command,  and  Paul 
Horst,  an  expert  in  statistics  and  test  theory. 

^G-ratings  involve  an  overall  assessment  of 
pilot  proficiency. 
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The  combat  validation  activities  of  several 
AAF  projects  during  World  War  II  are  reported  in 
one  of  the  19  volumes  reporting  the  work  of  the 
entire  Aviation  Psychology  Program  under  the  direc- 
tion of  Dr.  Flanagan. 3 The  research  team  collected 
data  for  combat  validation  on  the  performance 
of  navigators,  bomber  pilots,  and  fighter  pilots 
from  the  Seventh,  Eighth,  Ninth,  Tenth,  Twelfth, 
and  Fifteenth  Air  Forces. 

Two  technical  problems  which  plagued  the  group 
were  restricted  ranges  of  the  predictor  measures 
and  variation  in  opportunity  of  pilots  to  engage 
the  enemy  (Lepley,  1947).  The  former  was  due  to 
a cascaded  selection  process  which  eliminated 
unsuitable  combatants  at  several  steps  prior  to 
their  entrance  into  the  operational  environment. 

That  is,  a great  deal  of  inter-individual  varia- 
bility, which  probably  existed  in  several  measures 
of  the  population  of  potential  pilots,  had  been 
reduced.  The  opportunity  problem  is  a factor  which 
can  be  partially  controlled  by  matching  the  pilots 
by  number  of  missions  or  critical  missions,  but  has 
been  a pervasive  problem  in  attempts  at  combat 
validation  (see  Section  3.1). 

In  addition  to  the  large  scale  bomber  pilot, 
navigator,  and  bombardier  combat  validation  studies, 
a special  study  of  152  fighter  pilots  from  the  413th 
Fighter  Group  was  conducted.  This  study  was  de- 
signed to  ask  if  combat  proficiency  can  be  pre- 
dicted from  observations  made  in  the  Zone  of  the 
Interior.  Special  rating  procedures  were  developed 
for  this  study.  Pilots  were  rated  on  alertness, 
personality,  eagerness  for  combat,  dependability, 
air  discipline  and  teamwork,  conscientiousness, 
flying  proficiency,  and  overall  compatability. 
Ratings  of  pilots  at  the  end  of  four  months  of 
training  were  compared  with  ratings  of  the  combat 
proficiency  made  by  flight  leaders  after  9 to  16 
combat  missions  in  the  Pacific.  The  product-moment 
correlations  between  those  two  ratings  yielded  a 
correlation  coefficient  of  0.62  (Lepley,  1947, 
p.  187).  That  clearly  shows  better  than  chance 
prediction  of  combat  effectiveness.  This  is  one 
of  the  few  cases  where  the  combat  performance 

MDC  E1634  • 29  APRIL  1977 


of  fighter  pilots  has  been  predicted.  In  most  of 
the  studies  yielding  data  which  are  included  in 
Figure  3.2-2,  the  researchers  collected  data  and 
then  looked  back  to  see  how  well  they  could  have 
predicted  the  combat  criterion.  Though  the  pilots 
of  the  413th  Fighter  Group  were  flying  P-47s,  a 
plane  substantially  different  from  current  air 
superiority  fighter  planes,  testing  and  selection 
techniques  which  worked  in  that  situation  should 
still  be  applicable  since  substantial  overlaps  of 
critical  aviator  skills  exist. 

Though  Dr.  Flanagan's  group  executed  the  most 
thorough  research  program  on  AAF  personnel , some 
other  studies  were  performed  which  merit  discus- 
sion. Roff  (1950)  for  example,  administered  a 
rating  scale  of  characteristics  related  to  effec- 
tiveness in  combat  leadership  to  returned  flying 
officers.  His  goal  was  to  determine  the  relative 
importance  of  different  types  of  behavior  in  the 
command  situation.  "Strictness  of  Ground  Disci- 
pline" emerged  as  the  major  factor  in  this  study 
of  306  officers  rated  as  poor.  Unfortunately,  a 
bias  existed  in  this  study  because  of  the  after- 
the-fact  assessment  of  the  characteristics  of  the 
best  and  poorest  officers.  Because  of  this,  the 
statistical  significances  associated  with  the 
statistics  reported  from  the  Roff  study  in  Figure 
3.2-2  may  be  artificially  high.  Nevertheless, 
some  meaning  can  be  attached  to  the  relative  value 
of  the  various  characteristics  identified  as  de- 
scriptors of  the  combat  effective. 

Like  the  Army  Air  Forces,  the  Navy  had  a coor- 
dinated research  program  on  pilot  selection  during 
World  War  II.  Though  less  extensive  than  the  AAF 
program,  certain  similarities  in  problems  and 
approaches  existed.  The  Navy  program  was  under  the 
direction  of  Capt.  (Dr.)  John  G.  Jenkins.  As  with 
the  AAF  researchers,  the  Navy  researchers  performed 
an  extensive  job  analysis  and  search  for  valid 


^The  Lepley  volume  is  No.  17  in  that  set. 
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criteria.  As  Jenkins,  et  (1950)  put  it,  "It 
was  early  recognized,  . . . that  degree  of  profi- 
ciency exhibited  during  flight  training,  above  the 
requisite  level  for  completing  training  satisfactor- 
ily, might  not  be  correlated  highly  with  effective- 
ness in  combat."  This  is  a point  which  cannot 
be  overemphasized.  Not  only  are  many  of  the 
tasks  of  combat  aviation  more  demanding  than 
training  tasks  but  the  stress  of  actual  combat 
is  present. 

In  response  to  the  recognition,  within 
the  Navy  hierarchy,  of  the  importance  of  develop- 
ing a criterion  of  success  in  combat,  in  September 
of  1943,  three  officers  were  charged  with  identi- 
fying potentially  valid  "combat"  criteria.  After 
compiling  a file  of  1818  cases  of  pilots  judged 
good  or  poor,  the  three  investigators  delineated 
several  reasona' le  criteria.  These  included 
ratings  by  peers,  ratings  by  squadron  commanders, 
ratings  by  instructors,  success  in  field  carrier 
landing  practice,  torpedo  tactics  practice,  and 
training  records.  Other  members  of  the  Navy 
research  team  took  the  list  of  criteria,  and 
after  carefully  evaluating  scientific,  administra- 
tive, and  data  collection  restrictions,  the  Navy 
combat  criterion  for  the  major  World  War  II 
research  effort  was  established.  It  consisted  of 
"high"  versus  "low"  combat  nominations  by  peers. 

That  is.  Naval  aviators  with  combat  experience 
named  men  on  whom  they  would  be  glad  to  fly  wing, 
"highs,"  and  men  they  would  not  want  flying  wing 
on  them,  "lows."  Referring  to  the  development 
of  the  Navy  combat  criterion,  Fiske  (1947)  noted 
that  number  of  planes  shot  down,  decorations,  and 
other  proficiency  measures  were  found  inadequate 
in  preliminary  research.  This  undoubtedly  influ- 
enced the  choice  of  combat  nominations  as  the  com- 
bat criterion  to  be  used  in  World  War  II  Navy  pilot 
selection  research.  An  implicit  assumption  of 
the  combat  nomination  technique  is  that  peers  of 
the  combat  aviator  are  good  judges  of  his  effective- 
ness. This,  of  course,  is  one  manifestation  of 
the  criterion  problem  which  is  critical  to  proper 
validation  of  all  selection  devices.  There  is  no 
way  to  be  sure  that  peer  nominations  are  adequate 
as  a criterion. 
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The  exigencies  of  war  precluded  active  adher- 
ence to  certain  practices  regarding  selection  and 
training.  In  assessing  the  Naval  aviation  program 
of  World  War  II,  Captain  Jenkins  and  his  staff  were 
painfully  aware  that  success  in  training,  although 
a necessary  prerequisite  for  combat  success  was  not 
adequate  as  a criterion  for  the  selection  of  avia- 
tors. They  noted  (Jenkins,  et  al^  1950,  p.  168), 

"These  analyses  involving  test  score  data 
render  one  point  unequivocal.  The  test  bat- 
tery which  functioned  to  predict  success  in 
training  does  not  predict  this  combat 
criterion." 

Fiske  (1947,  p.73)  describing  the  Navy  program 
noted  that, 

"Although  the  need  for  validating  the  selec- 
tion tests  against  combat  criteria  was  repeat- 
edly stated  in  official  memoranda,  wartime 
expediency  prevented  the  establishment  of  this 
ultimate  check  during  the  early  years  of  the  war." 

Discussing  the  lessons  learned  by  psycholo- 
gists during  World  War  II,  Fiske  (1947,  p.  72) 
noted, 

"Psychologists  have  been  so  much  preoccupied 
with  the  immediate  task  of  constructing  reli- 
able measuring  devices  that  they  have  often 
slighted  the  criterion  itself.  It  was  the 
experience  of  the  aviation  group  that  con- 
structive efforts  to  improve  the  reliability 
and  the  significance  of  criterion  measures 
deserve  at  least  as  much  attention  as  that 
given  to  the  predictor  itself." 

As  can  be  plainly  observed  in  the  column  labeled 
Peer  Nomination  in  Table  3.1-2,  the  correlations 
between  the  predictors  used  and  the  Navy  combat 
criterion  were  very  low  except  for  the  predictor, 
military  rank,  which  is  a confounded  factor  if  one 
accepts  the  premise  that  the  effective  aviator  is 
more  likely  to  be  promoted.  A note  of  caution  must 
be  exercised  in  assessing  these  correlation  coeffi- 
cients, and  that  is  that  the  predictor  variables 
used  by  Jenkins,  al^,  (1950)  were  developed  pri- 
marily to  predict  training  success,  not  combat 
success.  That  research  team  did  note,  however, 
that  promise  was  indicated  for  the  development  of 
a combat  key  for  scoring  the  Biographical  Inventory, 
a specially  devised  life  history  questionnaire. 
Jenkins’  untimely  death  substantially  dampened  the 
Navy  selection  research  efforts  and  delayed  the 
reporting  of  the  results  of  the  World  War  11 
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activities  for  several  years.  Unfortunately,  major 
strides  in  the  direction  of  a more  refined  key  or 
better  biographical  inventory  were  not  made  by 
other  Naval  researchers. 

The  major  Navy  combat  validation  effort  was 
continued  until  the  end  of  Uorld  Uar  II.  Data  on 
4325  Navy  pilots  were  obtained  from  2872  men  station- 
ed in  the  Pacific.  Jenkins,  et  iL,  (1950)  performed 
a factor  analysis  on  that  data  to  identify  character- 
istics of  the  "high"  group.  Eight  characteristics 
were  tentatively  identified.  They  were  (1)  leader- 
ship and  responsibility,  (2)  teamwork,  (3)  practical 
intelligence,  (4)  combat  aggressiveness,  (5)  skill 
and  interest  in  flying,  (6)  seriousness,  conscien- 
tiousness, (7)  coolness,  steadiness,  and  (8)  easy- 
going sociability.  The  order  of  the  listing  of  the 
factors  above  reflects  the  rank  ordering  assigned 
by  a group  of  pilots  when  queried  by  the  Jenkins 
research  team.  Recognizing  that  their  peer  nomina- 
tion combat  criterion  was  imperfect,  Jenkins,  et  a1 , 
(1950)  hoped  to  use  these  initial  findings  for  the 
development  of  a more  sophisticated  peer  rating 
instrument. 

Viewing  the  problem  at  a more  general  level, 
Jenkins,  et  (1950)  noted  that  they  were  essen- 
tially looking  at  only  one  criterion.  They  also 
noted  that  an  overlap  between  combat  and  operational 
criteria  measures  must  exist.  Jenkins,  et  §X, 

1950,  p.  260)  at  the  conclusion  of  World  War  11 
were  saying, 

"Validation  of  selection  instruments  could  be 
made  in  terms  of  measures  of  those  areas  of 
operational  success  which  were  considered  com- 
mon to  combat  effectiveness.  Moreover,  arti- 
ficial situations  might  be  devised,  by  means 
of  which  potential  effectiveness  in  areas  of 
the  combat  criterion,  not  routinely  sampled 
in  the  operational  situation,  could  be  eval- 
uated." 

They  made  a strong  call  for  additional  research 
aimed  at  the  development  of  tests  predictive  of 
behavior  associated  with  the  areas  of  combat  per- 
formance. 

John  T.  Bair  (1952)  obtained  statements  from 
more  than  1000  World  War  II  combat  tested  Navy 
pilots  in  an  attempt  to  compare  the  attitudes  of 
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men  in  training  with  those  of  men  in  combat.  Stu- 
dents were  asked  to  describe  an  incident  which 
typified  the  best  and  worst  cadets  they  had  known. 
The  combat  criterion  used  in  the  Bair  study,  like 
that  in  the  Jenkins,  et  £l,  (1950)  work,  consisted 
of  naming  individuals  he  would  not  want  to  fly 
with.  Bair  did  not  report  quantitative  data,  but 
he  did  specify  these  characteristics  of  the  pilot 
wanted  in  combat  from  his  assessment  of  the  data: 

0 Teamwork  and  Consideration  for  Others 

0 Desire  to  Fly  and  Skill  in  Flying 

0 Personal  Stability  and  Calmness 

0 Social  Adaptability  and  Easy  Going 
Temperament 

0 Conscientiousness  and  Abilitv  to  Accent 
Responsibility. 

Bair  felt  that  the  best  cadets  and  men  wanted  in 
combat  compared  favorably.  He  made  only  qualita- 
tive comparisons  since  frequencies  of  response  were 
not  available. 

Using  the  Navy  combat  criterion,  Trumbull  and 
Backstron  (1946)  found  a relationship  between  job 
preference  and  success.  More  of  those  pilots  who 
had  shown  a strong  preference  to  be  fliers  were 
successful  than  those  who  wanted  ground  duty,  and, 
similarly,  assignment  to  a preferred  type  of  plane 
(e.g.,  fighters  as  opposed  to  bombers)  appeared  to 
be  related  to  combat  success.  This  lends  addi- 
tional credence  to  the  "Desire  to  Fly"  character- 
istic cited  by  Jenkins  al^,  (1950). 

A shift  away  from  selection  occurred  in  the 
Navy  research  community  late  in  World  War  II.  This 
was  primarily  a result  of  other  demands  on  the 
psychologists'  time  . . . "Undoubtedly,  this  shift 
of  emphasis  resulted  in  some  neglect  of  the  selec- 
tion program  in  which  there  was  always  considerable 
room  for  improvement."  (Fiske,  1947,  p.  71). 

Other  types  of  pilot  research  were  also  being 
conducted  in  the  theaters  of  war.  For  example,  a 
Special  Service  Division  memo  in  July  1944  reported 
a comparison  of  attitudes  toward  combat  flying  held 
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by  fighter  and  bomber  pilots.  Fighter  pilots  were 
more  willing  to  undertake  an  additional  series  of 
combat  missions  than  their  bomber  pilot  counter- 
parts. 

The  Civil  Aeronautics  Administration  (CAA) 
in  1939  joined  with  the  National  Research  Council 
(NRC)  and  created  what  became  the  CAA-NRC  Committee 
on  Selection  and  Training  of  Aircraft  Pilots 
(Viteles,  1945).  The  developments  made  by  that 
group  in  the  selection  and  training  of  civilian 
pilots  greatly  influenced  the  military  selection 
research  and  when  World  War  II  started,  leading 
aviation  psychologists  from  both  the  Army  Air 
Forces  and  the  Navy  joined  forces  with  the  CAA- 
NRC  group.  The  Committee  included  prominent 
psychologists,  physicians,  physiologists,  engineers, 
pilots,  and  military  men.  flembership,  in  addition 
to  the  chairman.  Morris  S.  Viteles.  included 
John  C.  Flanaoan  and  J.  G.  Jenkins.  In  summarizinn 
the  oractical  outcomes  of  the  work  on  oilot 
selection  and  classification.  Viteles  (1945) 
listed  the  following  four  items; 

0 The  validation  of  a number  of  predictors 
for  use  in  both  military  and  civilian 
aviation 

0 The  accumulation  of  data  on  predictors 
which,  although  not  fully  validated, 
represent  promising  instruments  for 
further  research,  and  application 

0 The  identification  of  tests  and  other 
techniques  which,  while  having  apparent 
face  validity  or  originally  recommended 
for  other  reasons,  proved,  upon  investi- 
gation, to  lack  reliability  or  validity 

0 The  identification  of  predictors  which, 
although  valid,  represent  uneconomical 
techniques  for  the  selection  and  classi- 
fication of  pilots. 


In  addition,  the  CAA-NRC  Committee  on  Selection 
and  Training  of  Aircraft  Pilots  provided  a forum 
for  the  exchange  of  information  on  pilot  selection 
and  stimulated  nationwide  interest  in  aviation 
psychology. 


3. 2. 2. 2 Korean  War  Studies  - Interest  in 
fighter  pilot  combat  effectiveness  was  renewed 
during  and  immediately  after  the  Korean  conflict. 
Noting  that  of  the  800  F-86  pilots  who  had  been 
on  25  or  more  counterair  missions,  less  than  10% 
scored  over  50%  of  the  kills,  the  Far  East  Air 
Forces  requested  an  assessment  of  what  makes  an 
ace.  HQS  USAF  responded  and  a team  of  scientists 
under  the  direction  of  Dr.  E.  Paul  Torrance  set 
out  to  find  some  answers.  Torrance  (1954)  developed 
a 100  item  preliminary  life  experience  inventory. 

This  questionnaire,  accompanied  by  interviews, 
Rorschach  tests,  and  an  ability  questionnaire, 
was  used  to  assess  over  700  fighter  pilots  evaluated 
in  a study  by  Torrance,  Rush,  Kohn  and  Doughty 
(1957).  Torrance,  et  aj,  (1957)  used  the  number 
of  kills  as  a basic  criterion  measure.  Direct 
comparisons  of  27  aces  and  27  nonaces  were  also 
made  by  this  group.  As  shown  in  Table  3.2-2,  age, 
rank,  time  service,  and  flying  time  were  found  to 
be  significantly  related  to  kill  claims.  The 
selection  devices  which  had  been  validated  on 
success  in  training  (e.g.,  stanines)  were  not 
shown  to  correlate  with  the  number  of  kills. 

In  the  comparison  of  aces  and  nonaces,  Torrance, 
et  (1957)  indicated  that  the  following  five  fac- 
tors differentiated  between  these  groups.  Aces 
tended  to  (1)  exhibit  fewer  childhood  neurotic 
behaviors,  (2)  achieve  better  social  adjustment, 

(3)  participate  in  a larger  number  of  every  day 
activities  involving  risk  and  strategy,  (4)  test  the 
limits  of  behavior  as  boys,  and  (5)  receive  more 
early  independence  training.  The  interview  data 
indicated  that  aces  exhibited  greater  motivation. 

This  was  evidenced  by  more  special  attempts  on  the 
part  of  aces  to  become  fighter  pilots  and  overt 
efforts  to  obtain  additional  combat  duty. 
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The  Torrance  Life  Experience  Inventory  and  a 
large  set  of  other  measures  were  used  by  Straw- 
bridge  and  Kahn  (1955)  in  an  intensive  study  of 
Korean  pilots.  There  was  some  subject  overlap  as 
73  of  the  subjects  participating  in  that  study 
had  also  been  evaluated  in  the  Torrance,  et  a1 . 
(1957)  study.  Strawbridge  and  Kahn  questioned  the 
validity  of  the  raw  number  of  kills  as  the  primary 
measure  of  combat  effectiveness.  They  argued  that 
opportunity  and  other  artifactual  factors  were  in- 
volved in  getting  kills  and,  because  of  this,  some 
better  measures  of  fighter  pilot  combat  effective- 
ness were  possible.  Strawbridge  and  Kahn  (1955) 
suggested  some  alternatives  and  used  as  their 
criteria  these  nine  variables:  M,  K,  S/M,  E/S, 

F/E,  K/F,  A,  B,  C 
where: 

M is  the  number  of  combat  missions  flown  by 
a pilot  while  on  duty  with  the  Fourth  Fighter 
Interceptor  or  Wing  in  Korea. 

S is  the  number  of  occasions  when  enemy 
aircraft  formations  were  sighted  by  a friendly 
flight  on  combat  patrol  while  the  pilot  was 
serving  as  a leader  in  the  flight.  Leader 
as  used  here  is  defined  to  mean  a pilot  flying 
Ho.  1 position  in  a flight  or  element,  a pilot 
flying  No.  3 position  when  flying  as  an  ele- 
ment, any  pilot  when  firing  on  the  enemy,  and 
any  pilot  when  flying  alone. 

E is  the  number  of  encounters  with  enemy  air- 
craft when  on  combat  patrol  as  leader.  An 
encounter  is  here  defined  to  mean  any  attempt 
of  a pilot  to  close  on  the  enemy  following  a 
sighting  or  the  initiation  of  an  attack  by 
the  enemy. 

F is  the  number  of  enemy  aircraft  fired  upon 
by  a pilot  when  serving  as  leader. 

K is  the  number  of  enemy  aircraft  destroyed 
by  a pilot.  This  is  a weighted  kill  measure 
in  which  a destruction  is  assigned  a value  of 
1.00,  a probable  destruction  0.75  and  a dam- 


age of  0.25.  Shared  credits  between  two  or 

more  pilots  are  scored  accordingly. 

Index  A is  an  adjusted  ratio  of  kills  per  oppor- 
tunity. Index  B is  based  upon  M,  S,  E,  F,  and  K. 
Index  C is  similar  to  B but  with  an  adjustment  for 
opportunity  associated  with  position  in  the  forma- 
tion. 

Clearly,  mission  differences  and  even  position 
in  formation  differences  (lead  versus  wing)  can 
influence  the  number  of  kills.  As  noted  by  Straw- 
bridge  and  Kahn  (1955) , a pi  lot  who  flew  a dispro- 
portionately large  number  of  reconnaissance,  inter- 
cept, air  rescue,  or  escort  missions  had  less 
opportunity  to  encounter  the  enemy.**  Another 
legitimate  and  related  problem  with  number  of 
kills  as  the  primary  criterion  measure  has  to  do 
with  its  sensitivity.  As  an  all  or  none  measure, 
which  occurs  relatively  infrequently,  kills  might 
bypass  some  excellent  pilots.  Kills  might  legiti- 
mately be  augmented  with  some  additional  measures 
of  pilot  performance,  but  the  face  validity  and 
apparent  utility  of  such  a measure  is  so  overwhelm- 
ing that  any  dismissal  of  it  as  major  criterion  of 
air-to-air  combat  effectiveness  is  unthinkable. 

Strawbridge  and  Kahn  (1955)  correlated  some 
of  the  42  predictors  (shown  in  Figure  3.2-2)  with 
their  criterion  variables.  In  Figure  3.2-2  one 
can  see  that  those  predictors  covered  a wide  range 
of  pilot  skills  and  characteristics.  Experience 
factors,  (e.g.,  flying  hours),  aggressiveness, 
risk  taking,  and  general  information  yielded  the 
highest  correlations  with  the  kills  measure. 

Most  highly  correlated  with  the  Strawbridge  and 
Kahn  indices  of  combat  effectiveness  were  flying 
experience  and  the  life  history  factors  of  parental 
control  and  the  parental  striving.  The  Strawbridge 
and  Kahn  study  appears  to  be  one  of  the  best 
conceived  studies  of  combat  effectiveness  encoun- 
tered by  the  present  research  team. 


‘‘For  a discussion  of  opportunity  see  Section 
3.1. 
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The  call  for  research  from  the  Far  Eastern 
Air  Forces  also  led  to  the  study  of  combat  crew 
attitudes  (Deqauqh  and  Knoell,  1954;  Knoell  and 
Stice,  1954;  Knoell,  French  and  Stice,  1953).  In 
a sample  of  forty-two  Korean  War  B-29  crews  which 
flew  bombing  and  propaganda  missions  over  North 
Korea,  Knoell  (1956)  was  able  to  show  significant 
relationships  between  attitudes  measured  in  train- 
ing and  combat  performance  as  reflected  in  ratings 
of  crew  performance  made  by  superior  officers.  The 
three  attitude  scales  which,  for  Knoell,  predicted 
combat  performance  best  were  sense  of  personal  well- 
being in  the  Air  Force,  acceptance  of  Air  Force 
goals,  and  liking  for  ones  own  crew.  The  sample  in 
the  Knoell  Study  was  not  limited  to  pilots  but  in- 
volved the  entire  aircrew,  i.e.,  aircraft  commander, 
pilot,  navigator,  radar  observer,  bombardier, 
flight  engineer,  radio  operator,  and  four  gunners. 
Knoell  found  that  two  conclusions  were  supported, 

".  . . namely,  that  crew  attitudes  measured  in 
training  predict  rated  crew  combat  performance 
significantly,  and  that  crew  attitude  measures  in 
combat  are  correlated  significantly  with  the 
crews'  rated  combat  performance."  (Knoell,  1956, 
p.  15). 

With  full  awareness  that  Air  Force  tests  were 
being  validated  on  training  success,  not  on  per- 
formance in  the  operational  environment,  Tupes 
surveyed  and  developed  some  officer  effectiveness 
measures  (Tupes,  1957).  For  that  more  general 
purpose,  five  types  of  predictors  were  thought 
appropriate.  They  were  (1)  peer  and  superior 
ratings  of  leadership  potential,  (2)  peer  ratings 
on  personality  traits,  (3)  a biographical-interest- 
personality  inventory,  (4)  a physical  proficiency 
test,  and  (5)  a situational  performance  test 
series.  Tupes,  Carp,  and  Borg  (1957)  validated 
the  battery  on  four  intermediate  criteria.  Three 
of  the  four  criterion  variables  were,  however, 
training  based  (OCS  graduation,  DCS  final  military 
grade,  OCS  final  academic  grade). 

The  breadth  of  the  selection  research  activity 
during  the  Korean  conflict  is  evidenced  by  research 
on  the  part  of  the  Department  of  Clinical  Psychology 


of  the  USAF  School  of  Aviation  Medicine.  Saul  B. 
Sells  directed  a program  which  sought  to  develop 
a battery  of  tests  which  would  select  out  those 
individuals,  "...  unduly  predisposed  to  difficul- 
ties in  adapting  to  the  manifold  vigors  of  the 
various  stages  of  military  flying  duty."  (Sells, 
1956,  p.  440).  In  that  effort,  a simple  pass-fail 
criterion  in  flight  training  was  rejected  because 
a broader  criterion  than  that  of  flying  proficiency 
was  desired.  Post  training  flying  proficiency  was 
determined  from  personnel  records  and  flying 
experience  records  as  well  as  ratings  of  combat 
adjustment  and  objective  mission  and  performance 
data  collected  in  Korea  in  1951  and  1953.  In 
addition  to  the  correlations  between  adjustment 
ratings  in  training  and  the  combat  criterion 
obtained  in  Korea  which  appear  in  Table  3.1-2, 

Sells  and  his  co-workers  reported  correlations 
with  the  noncombat  post-training  criteria.  These 
data  are  not  included  here,  but  they  also  can  be 
used  to  support  the  contention  that  more  than 
training  criteria  should  be  used  in  validating 
pilot  selection  instruments.  (Also  see  Sells  and 
Trites,  1957;  Trites  and  Kubala,  1957;  Sparks  and 
Niess,  1956.)  Another  point  made  in  the  Sells 
work  is  that  personality  factors  should  be 
evaluated  as  an  important  component  of  a success- 
ful selection  program. 

Trites  and  Sells  (1957)  were  specifically  con- 
cerned with  the  extent  to  which  peer  ratings  of 
performance  could  be  used  as  criteria.  Working  on 
the  assumption  that  the  better  pilots  fly  more  com- 
bat and  the  poorer  pilots  fly  more  noncombat  hours, 
Trites  and  Sells  selected  the  number  of  combat 
hours  as  their  objective  criterion  of  combat  per- 
formance. Also  used  as  criteria  were  peer  and 
superior  ratings  and  psychologists'  ratings.  The 
intercorrelations  between  the  peer-superior  ratings 
in  the  combat  arena  and  combat  hours  generally  were 
positive  but  lower  than  one  might  expect  (see 
Figure  3.2-2). 

The  effectiveness  of  bomber  crews  in  Korea 
was  evaluated  for  the  period  March  to  September 
1951  by  Hemphill  and  Sechrest  (1952).  Bombing 
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accuracy  (circular  error),  sociometric  nominations 
by  crew  members,  and  superiors'  ratings  were  the 
three  criteria  used.  Though  bombing  accuracy  has 
high  relevance  and  face  validity  as  a criterion  of 
combat  effectiveness,  it  is  not  a perfect  criter- 
ion. Hemphill  and  Sechrest  noted  three  major  weak- 
nesses in  that  measure:  (1)  variable  conditions 

under  which  bombing  must  be  done;  (2)  limitations 
on  measuring  accurately  where  bombs  hit;  and 
(3)  differences  in  the  task  of  various  crews  in  a 
bombing  formation  (lead  crews  have  more  tasks  to 
perform  than  do  the  other  crews).  It  was  obvious 
to  those  researchers  that  superiors'  ratings  were 
strongly  influenced  by  objective  bombing  data. 

This  led  the  researchers  to  question  rating  data 
as  criteria  in  combat  settings.  Data  on  eleven 
factors  of  aircrew  performance  were  evaluated  in 
that  study.  (See  Figure  3.2-2.) 

The  same  researchers  (Sechrest  and  Hemphill, 
1954)  also  evaluated  motivational  variables  asso- 
ciated with  the  assumption  of  combat  obligations. 

A group  of  283  men  who  went  overseas  to  combat 
assignments  were  contrasted  with  57  men  with  the 
same  opportunity  who  did  not  go.  The  following 
four  patterns  of  attitudes  characterized  the  men 
who  went  overseas;  (1)  general  satisfaction  with 
the  Air  Force;  (2)  more  concern  with  opportunities 
for  training  and  education;  (3)  less  frequent 
somatic  complaints;  and  (4)  feelings  of  general 
social  responsibility. 

Naval  combat  research  efforts  during  the 
Korea  period  appear,  from  our  literature  search,  to 
be  very  limited.  One  pertinent  study  is  noted. 
McGehee  (1951)  surveyed  flight  surgeons,  command 
and  training  officers,  and  others  at  naval  aviation 
installations  to  explore  new  directions  for  research 
in  naval  aviation.  His  observations  and  recommenda- 
tions regarding  pilot  selection  were  first,  that 
a pass-fail  criterion  was  relied  upon  too  heavily 
and  should  be  augmented  by  some  measure  of  success 
in  the  operational  environment.  Second,  it  was 
noted  that,  except  at  the  lowest  levels,  less  con- 
cern was  shown  for  flying  ability  than  for  the 
ability  to  perform  other  military  duties.  McGehee 


recommended  an  analysis  of  critical  behaviors  for 
the  various  job  components  and  selection  according 
to  the  duties  to  be  performed. 

3. 2. 2. 3 Southeast  Asian  Studies  - Since  the 
Korean  conflict,  very  little  attention  has  been 
allocated  to  personnel  selection  with  respect  to 
combat  effectiveness.  Those  studies  which  have 
shed  light  on  the  subject  were  conducted  largely 
for  other  purposes. 

The  Weapons  System  Evaluation  Group  (WSEG) 
conducted  an  extensive  investigation  of  air-to-air 
encounters  in  Southeast  Asia.  The  major  purpose 
of  this  project,  code  named  RED  BARON  I,  was  to 
identify  research  programs  pertinent  to  the  improve- 
ment of  aircraft  weapons.  One  of  the  six  principal 
areas  of  interest  was  man-machine  compatibility. 

RED  BARON  II,  directed  by  the  USAF  Tactical  Fighter 
Weapons  Center,  analyzed  625  Southeast  Asia  air-to- 
air  encounters  from  the  1967-1968  time  period  as 
well  as  some  data  collected  during  the  1965-1967 
RED  BARON  I period.  In  that  analysis,  MIG  killers 
were  shown  to  have  more  flight  experience  than  non- 
killers. The  RED  BARON  III  (even  later  in  the  war) 
data  analysis  suggested  however,  that  combat  exper- 
ience, not  flying  experience,  is  the  more  important 
variable  in  air-to-air  combat  success  (deLeon. 

1977). 

Like  many  research  activities  reviewed,  the 
RED  BARON  studies  were  not  performed  with  the  iden- 
tification of  pilot  characteristics  as  a central 
purpose.  Statements  made  by  pilots  interviewed 
during  the  RED  BARON  studies  revealed  character- 
istics these  pilots  felt  were  important,  but  these 
add  little  to  the  list  of  critical  skills  and 
characteristics  which  emerges  from  the  studies  that 
have  quantitatively  evaluated  pilot  performance  in 
combat  and  other  samplings  of  pilot  opinion. 

Other  studies  which  were  performed  during  SEA 
tended  to  be  more  narrowly  focused.  Naval  Aero- 
space Medical  Institute  reports  during  the  South- 
east Asian  conflict  (Rickus  and  Berkshire,  1968, 
Berkshire,  1969)  are  representative  of  recent  work 
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in  the  Naval  selection  program.  Those  authors 
advocate  only  the  use  of  subjective  criterion 
measures  in  the  evaluation  of  pilot  performance. 
Specifically,  they  support  the  use  of  flight  sur- 
geons as  a collection  point  for  ratings  of  combat 
performance.  They  state  that  only  subjective  eval- 
uations have  been  able  to  predict  pilot  performance 
with  any  degree  of  success.  The  present  writers 
must  disagree  with  this.  While  subjective  evalua- 
tions have  been  useful , the  success  of  some  objec- 
tive and  quant-ifiable  criterion  measures  as  reported 
by  Lepley  (194ij'^*d  "Slrawbridge  and  Kahn  (1955) 
among  others  has  esta.yished  a clear  precedent  that 
quantitative  criterion  measures  can  be  used  effec- 
tively. 

An  Air  Force  study  by  Ratliff,  Shore,  Chiorini 
and  Curran  (1969)  QoujittCled'  in  Southeast  Asia  as 
part  of  Project  Combat  Team  attempted  to  determine 
the  effects  of  training  on  F-4  second-seater  combat 
performance.  They  concluded  that  a task  inventory 
would  be  helpful  in  assessing  the  effects  of  train- 
ing programs  on  combat  performance.  This  work  was 
followed  up  by  a comparison  of  pilots  and  navigators 
in  second-seat  performance,  and  it  was  found  that 
after  about  30  missions  no  performance  differences 
existed.  (Shore,  Curran,  Ratliff,  & Chiorini, 

1970).  These  authors  stressed  the  fact  that  they 
were  able  to  obtain  reliable  and  valid  proficiency 
data  in  a combat  environment.  This  incidental  ob- 
servation is  quite  important  as  it  demonstrates 
the  feasibility  of  research  in  a modern  USAF  combat 
environment. 


/ 


not  as  high  as  those  predicting  to  training,  but 
encouraging,  nevertheless. 

A somewhat  related  study  which  deals  more  with 
a classification  problem  than  a selection  issue  is 
that  of  Miller  (1974).  He  examined  the  assignment 
of  personnel  to  a particular  specialty  such  as 
transport,  fighter,  or  reconnaissance  (recce)  based 
upon  special  predictors.  Such  assignment  was  found 
to  be  possible.  Undergraduate  pilot  training  grades 
and  biographical  data  were  compared  with  peer  rat- 
ings of  general  competence  as  a pilot.  For  this 
study,  certain  measures  which  significantly  predict 
competence  in  transport  flying  did  not  predict 
fighter  pilot  competence  or  competence  as  a recce 
pilot.  The  predictions  can  be  found  in  Figure 

3.2- 3.  Most  striking  were  two  UPT  variables.  "Con- 
tact Flying.  Basic"  and  "Flying  Training  Grade." 

These  factors  (note  underlined  variables  in  Figure 

3.2- 3)  were  significantly  correlated  with  both  trans- 
port competence  ratings,  but  the  correlations  were  in 
different  directions.  One  obvious  implication  of 
these  findings  is  that  discriminations  can  be  made 
early,  which  would  be  useful  for  improving  not  only 
pilot  selection  but  pilot  classification  in  general. 

Though  few  studies  have  produced  data  relating 
predictors  to  combat  performance,  numerous  analyt- 
ical documents  have  emerged.  These  have  come  pri- 
marily from  officers  who  are  students  at  either 
the  Naval  Postgraduate  School  at  Monterey, 

California,  or  the  Air  University  at  Maxwell  Air 
Force  Base,  Alabama. 


After  an  assessment  of  critical  skills. 

Shannon  and  Waag  (1972,  1973)  were  able  to  develop 
two  fleet  evaluation  questionnaires  which  were 
completed  by  F-4  squadron  commanders  and  used  as 
criterion  measures  in  an  analysis  of  fighter  pilot 
performance  in  Southeast  Asia.  A multiple  regres- 
sion model  using  the  fleet  evaluations  as  the  cri- 
terion variables  and  experience  level,  formation 
grade,  tactics  grade.  Replacement  Air  Group  grade, 
and  a flight  aptitude  rating  as  predictor  variables 
yielded  a cumulative  multiple  R of  .40.  This  was 


Some  of  these  analyses  are  very  useful  for 
identifying  the  characteristics  of  the  successful 
pilot.  This  is  true  even  though  the  conclusions 
are  not  based  on  quantified  objective  relationships 
between  predictors  and  combat  criteria. 

Stanley  (1973)  used  interviews  and  rating 
forms  to  perform  a critical  incident  study  and 
observed, 

"Current  naval  aviator  selection  and  screening 
procedures  are  based  on  the  individual's  sta- 
tistical probability  of  completing  flight 
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FIGURE  3.2-3  RELATIONSHIPS  BETWEEN  SIGNIFICANT  PREDICTORS  AND  PERFORMANCE  IN  SPECIALTY  AREA 
AS  INDICATED  BY  PEER  RATINGS  (After  Miller,  1974) 


training  and  do  not  determine  the  capability 
of  the  student  to  adapt  to  an  operational 
environment.  The  resultant  failure  of  some 
student  aviators  to  complete  the  advanced 
stages  of  training  and  the  ineffective  per- 
formance of  others  in  operational  missions 
have  caused  a considerable  financial  loss  and 
a lessening  of  combat  readiness."  (p.  2) 

In  his  study  Stanley  evaluated  30  aviators. 
Twenty-nine  of  these  had  their  combat  experience 
(at  least  25  missions)  in  Southeast  Asia.  The 
other  subject  was  an  Israeli  Air  Force  pilot. 
Descriptions  of  instances  (critical  incidents) 


of  effective  and  ineffective  performance  were 
obtained  in  tape  recorded  interviews  with  these 
aviators.  Four  raters  independently  compiled 
lists  of  behaviors  which  occurred  during  the  crit- 
ical incidents.  After  minor  semantic  differences 
were  resolved,  several  descriptors  of  effective 
and  ineffective  combatants  were  identified.  Five 
of  these  dimensions  seemed  potentially  important 
for  distinguishing  between  effective  and  ineffec- 
tive pilots.  These  were  situation  awareness, 
procedural  ability,  decision  making  capacity, 
determination,  and  stress  capacity. 
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A useful  analytical  study  is  the  Air  War  Col- 
lege research  report  of  Cook  (1972).  After  serving 
in  the  Air  Force's  Air  Training  Command  (ATC), 
Colonel  Cook  expressed  concern  that  we  have  been 
selecting  pilots  for  quantity  in  recent  years. 
Citing  his  experience,  he  noted, 

" I and  my  other  check  pilots  began  to  note 

that  the  truly  outstanding  student--the  man 
capable  not  only  of  performing  maneuvers  with 
a high  degree  of  skill,  but  also  able  to  make 
correct  decisions  quickly  while  airborne--was 
becoming  increasingly  rare.  Instead,  more  and 
more  students  were  encountered  who  could  not 
cope  with  as  simple  a matter  as  changing  the 
mission  profile  in  flight  to  meet  varying 
weather  conditions  or  an  unexpected  area 
assignment. 

"Later,  field  evaluation  reports  gave  support 
to  these  observations,  and  also  revealed  that 
these  student  deficiencies  were  not  unique  to 
one  training  base,  but  were  being  discovered 
throughout  ATC"  (Cook,  1972,  pp.  10-11). 

After  examining  specific  possible  weaknesses 
in  the  pilot  training  system.  Cook  had  several 
recommendations.  Important  to  tne  present  research 
was  the  recommendation  that  present  pilot  selection 
criteria  be  carefully  reviewed  and  upgraded.  In- 
cluded in  this  recommendation  was  possible  waiving 
of  the  college  degree  requirement  and  inclusion  of 
some  measure  of  eagerness.  The  central  theme  of 
the  Cook  report  was  that  the  U.S.  Air  Force  should 
select  for  quality  not  quantity. 

Another  Air  University  research  report  ana- 
lyzing pilot  selection  in  the  Air  Force  is  that 
of  Cooper,  Imaye,  Karre,'  Robertson,  Ryan,  and 
Sakahara  (1976).  The  theme  of  their  analysis  was 
that  the  universally  assignable  pilot  concept  is 
not  valid  and  it  should  be  replaced  by  a system 
applying  operational  pilot  selection  criteria  to 
place  pilot  candidates  in  particular  classes  of 
planes  according  to  their  specific  skills  and 
abilities.  They  argue  for  the  inclusion  of  psy- 
chological tests  ranging  from  life  inventories  to 
open-ended  personality  tests  and  for  psychophysio- 
Icgical  evaluation  of  critical  factors  like  suscep- 
tibility to  airsickness,  "G"  tolerance,  and  alti- 
tude chamber  tolerance.  They  also  recognized  the 
utility  of  simulators  as  selection  devices,  not 


just  training  devices.  These  pilots  specified 
four  factors  which  they,  as  a group,  felt  were 
mandatory  for  survival  in  flying  fighter  planes. 
They  are  motivation,  aggressiveness,  judgement, 
and  reaction  to  stress.  They  felt  that  the  four 
factors  were  not  directly  testable  and  recommended 
instructor  pilot  evaluations  in  these  areas.  The 
present  researchers,  while  acutely  sensitive  to 
the  difficulties  associated  with  measuring  these 
factors,  feel  that  these  factors  are,  though  not 
without  substantial  development,  testable.  One 
pleasing  feature  of  the  Cooper,  et  a^,  (1976) 
study  was  that  this  report,  produced  by  pilots, 
included  a set  of  recomnendations  overlapping 
with  ours. 

3.2.3  Summary  and  General  Implications  of 
the  Aviation  Combat  Studies  - As  stated  in  the 
introduction  to  Section  3.2,  the  research  on  air- 
crew performance  in  combat  has  been  limited. 
Nevertheless,  several  important  general  implica- 
tions emerge  from  the  research  which  has  been  done. 

Selection  for  combat  effectiveness,  not  just 
training  success,  can  be  done.  Workable  criteria 
of  combat  success  are  available  and  can  be  recorded 
in  an  aviation  combat  environment,  and  strong 
precedent  for  aviation  selection  research  in  a 
combat  environment  has  been  demonstrated. 

Many  researchers  who  have  performed  aviation 
selection  research  were  unable  to  validate  on  com- 
bat criteria  adequately  because  no  adequate  data 
collection  plan  was  immediately  available.  This 
tended  to  create  a restriction  so  that  when  a plan 
could  be  approved  and  implemented  much  of  the  use- 
ful data  were  no  longer  available.  The  best 
possible  outcome  for  this  type  of  research  without 
a well  thought-out  plan  is  to  demonstrate  con- 
current validity,  not  the  more  desirable  predictive 
val idity. 

A wide  variety  of  predictor  variables  have 
shown  promise  as  predictors  of  both  objective 
and  subjective  criteria  of  combat  success.  Further 
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discussion  of  specific  categories  of  predictors 
win  be  found  in  Section  4.0  in  conjunction  with 
the  results  of  studies  of  nonaviation  combat  selec- 
tion research  (Section  3.3)  and  data  from  aviation 

selection  studies  which  used  training  success  for  I . 

a criterion  (Section  3.4).  i 
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3.  3 SCIENTIFIC  STUDIES  OF  INDIVIDUAL  EFFECTIVENESS 
IN  NON-AVIATION  COMBAT  AND  COMBAT  SURROGATES 

Figure  3.3-1  shows  studies  of  combat  effective- 
ness conducted  in  non-aviation  settings  and  research 
efforts  on  performance  in  simulated  combat  environ- 
ments. It  is  clear  if  one  inspects  Figure  3.3-1  and 
contrasts  it  with  Figure  3.2-1  that  there  has  been  a 
pattern  of  research  on  combat  effectiveness  in  the 
nonflying  military  community  which  is  different  from 
that  in  the-  flying  community.  Not  only  is  a dif- 
ferent emphasis  revealed  in  the  two  figures,  but  the 
"Army  in  Korea"  cell  of  Figure  3.3-1  has  more 
entries  than  any  cell  of  either  matrix  making  the 
following  point  clear-- the  army , more  than  any 
other  service,  has  recognized  the  need  for  optimiz- 
ing individual  combat  performance.  Furthermore, 
there  is  evidence  that  steps  have  been  taken  to 
implement  a combat  effectiveness  selection  program 
(Helme,  Willemin,  and  Grafton,  1974). 

The  combat  task  of  the  fignter  pilot  is  gener- 
ally considered  more  complex  and  intellectually 
demanding  than  the  combat  task  of  the  infantryman, 
yet  substantially  more  effort  has  been  poured  into 
evaluating  the  performance  of  the  infantryman. 
Considering  the  complexity  of  the  fighter  pilot's 
task  and  the  dollar  value  of  the  equipment  involved, 
one  might  expect  to  find  relatively  more  research 
into  air  combat  effectiveness  than  infantry 
effectixeness. 

Following  the  Korean  War,  combat  surrogate 
situations  were  used  by  the  Army  researchers 
enabling  them  to  specify  the  necessary  critical 
skills  and  to  evaluate  characteristics  (such  as 
stress  tolerance)  which  were  not  fully  evaluated  in 
the  onbat  aviation  studies.  During  periods  other 
mim  ‘he  Korean  conflict  and  immediately  after,  the 
* , -lection  research  was  reduced  substantially 

- eition  research  in  the  other  services. 

•aMons  have  done  relatively  little 
• ' '"*at  abi  lity.  A major  excep- 

ahtch  was  performed  by  the 
rr  - !•-  <tunnq  World  War  II 


Figure  3.3-2  shows  data  from  studies  performed 
in  non-aviation  combat  and  surrogate  combat  situa- 
tions. Across  the  top  of  this  figure  are  thirty 
criteria  which  have  been  used  in  this  type  of  study. 
Along  the  left-hand  margin  are  the  predictors  which 
have  been  evaluated.  The  entries  are  correlations 
except  for  the  nomination  criterion  where  entries 
are  critical  ratios  comparing  groups  of  soldiers 
nominated  into  upper  and  lower  groups.  A slash 
indicates  a range  of  values.  Combat  criteria  used 
include  combat  ratings,  combat  performance  ratings, 
NCO  and  Personnel  Research  Branch  technician  ratings 
in  combat,  company  commanders'  ratings  of  combat 
performance,  officer  efficiency  reports  for  combat 
duty  in  Korea,  and  combat  nominations  made  by  peers. 
All  of  these  combat  criteria  rely  upon  some  form  of 
rating.  Figure  3.3-2  is  useful  as  an  aid  to 
comprehending  studies  cited  individually  in  this 
section  and  as  a tool  for  use  in  developing  a 
profile  of  the  combat  effective  individual  (See 
Section  4). 

3.3.1  Criterion  Problems  - Specification  of 
reasonable  criteria  for  validating  a selection 
instrument  for  infantrymen  or  for  other  Army  roles 
is  inherently  more  difficult  than  specifying 
criteria  of  aviator  effectiveness.  In  the  aviation 
environment,  some  recordable  measures  exist  (kills, 
rounds  fired,  encounters,  etc.).  In  the  infantry 
environment,  no  gun  camera  records  or  otner  records 
of  individual  performance  are  practicably  available. 
Because  of  this,  the  researchers  from  the  Human 
Resources  Research  Organization  (HumRRO)  and  (what 
is  now)  the  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences  (ARI)  were  forced  to 
resort  to  other  indices  of  individual  combat  effec- 
tiveness. After  stepping  through  the  same 
preliminary  stages  as  the  Navy  did  in  World  War  II, 
these  researchers • decided  upon  criteria  dependent 
upon  information  provided  by  the  soldiers'  peers. 
Thus,  they  relied  on  an  intermediate  criterion 
based  on  data  collected  in  close  temporal  and 
spatial  proximity  to  the  actual  fighting. 


Another  approach  which  was  widely  used  in  the 
Army  research  effort  was  to  identify  skills 
required  in  the  combat  environment  and  test  for 
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OF  EACH  COLUMN.  (Continued) 
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FIGURE  3.3-2  STATISTICAL  RELATIONSHIPS  BETWEEN  CRITERIA  OF  COMBAT  EFFECTIVENESS  AND  EVALUATED  PREDICTORS  FOR 
OF  EACH  COLUMN. (Continued)  J 
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them.  An  example  of  this  is  the  investigation  of 
performance  in  stressful  environments.  The  specific 
criterion  problems  faced  by  the  various  research 
groups  will  be  considered  in  conjunction  with  the 
discussion  of  specific  programs. 

3.3.2  World  War  II  Studies  - During  World 
War  II,  the  Research  Branch,  Information  and  Educa- 
tion Division,  United  States  Army,  performed  exten- 
sive research  on  the  cotrtbat  soldier  (Stouffer, 
Suchman,  DeVinney,  Star  and  Williams,  1949). 

Unlike  what  was  to  follow  in  Korea,  measures  of 
combat  effectiveness  were  not  recorded  at  the  front 
lines.  However,  the  studies  performed  in  World  War 
II  laid  the  groundwork  for  later  studies  by  creating 
more  respect  within  the  military  heirarchy  for 
personnel  research.  The  World  War  II  researchers 
studied  personal  adjustment,  job  satisfaction,  and 
attitudes.  The  general  focus  was  on  the  individual 
as  a member  of  a social  system.  Many  factors  noted 
in  that  extensive  description  of  the  soldier 
undoubtedly  influence  combat  effectiveness,  but 
specific  research  about  individual  combat  effective- 
ness was  not  included  in  that  work.  Just  as  the 
Army  Air  Force's  Aviation  Psychology  Program  drew 
together  many  leading  experimental  psychologists, 
this  World  War  II  study  of  the  infantryman  drew  upon 
the  best  research  personnel  resources  available,  and 
prominent  sociologists  and  social  psychologists  were 
included. 

One  of  the  most  thoughtful  treatments  of  the 
combat  effectiveness  of  the  individual  soldier  was 
that  of  S.  L.  A.  Marshall,  the  Army  historian  of  the 
European  Theater  of  Operations.  One  point  he  makes 
which  must  be  kept  in  mind  is  that  men  change 
character  under  fire.  Because  of  this,  any  adequate 
selection  program  must  be  validated  against  the 
ultimate  criteria,  performance  in  combat.  Training 
success  could  not  possibly  include  the  stress 
associated  with  the  innmediate  threat  of  death.  As 
Marshall  put  it, 

"The  near  presence  of  death  and  the  prospect 
of  meeting  it  at  the  next  moment  move  men  in 
many  curious  ways.  Many  men  seem  to  change 
character  under  the  guns.  The  life  of  hard- 
ship and  of  danger  gives  new  strength  to  the 
truly  strong  and  greater  weakness  to  the  truly 
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weak.  The  erstwhile  fatalist  may  become  the 
most  superstition-ridden  man  in  a company. 

The  dreamer  may  become  a realist.  The  back- 
ward man  may  come  forward.  The  arrogant  may 
develop  new  bounds  of  compassion.  The 
'natural  born  leader'  may  lose  his  vital 
spark.  All  men  who  have  known  battle  have 
seen  such  strange  transformations." 

(Marshall,  1947,  p.  184) 

A major  World  War  II  personnel  research  effort 
which  has  strongly  influenced  social  psychology  in 
the  last  30  years  is  that  of  the  Office  of  Strategic 
Services  (OSS).  The  personnel  selection  work  of 
the  OSS,  while  not  directed  toward  selecting  combat 
performers  as  conventionally  defined,  was  clearly 
aimed  at  selecting  people  who  should  be  able  to 
work  in  high  stress,  combat-like  situations.  In 
applying  their  "scientific  art  of  arriving  at 
Sufficient  conclusions  from  insufficient  data"  (the 
OSS  Assessment  Staff,  1948,  p.  8),  the  OSS 
psychologists  identified  seven  major  general  behav- 
ioral variables  and  three  additional  special  or 
task  specific  variables.  The  general  variables 
were  (1)  motivation  for  assignment,  (2)  energy  and 
initiative,  (3)  effective  intelligence,  (4) 
emotional  stability,  (5)  social  relations,  (6) 
leadership,  and  (7)  security.  The  special  factors 
were  physical  ability,  observing  and  reporting, 
and  propaganda  skills. 

A unique  aspect  of  the  OSS  work  was  the  prece- 
dent set  when  holistic  testing  was  used  effectively 
as  part  of  the  selection  routine.  Holistic  testing 
enabled  the  selection  team  to  create  a stressful 
test  situation  which  would  not  be  possible  without 
such  extensive  control  of  the  test  environment. 
Unfortunately,  no  systematic  validation  of  this 
selection  program  was  ever  undertaken,  so  the  ten 
factors  listed  above  are  only  at  the  level  of 
clinical  observation.  The  OSS  staff  was  aware  of 
this  shortcoming.  They  said. 


"In  establishing  the  OSS  assessment  unit,  we 
erred  in  not  making  provision  from  the  start 
for  validation  studies.  No  member  of  the 
staff  then  had  time  to  devote  to  the  crucial 
task  of  organizing  a system  of  appraisal. 

When  we  finally  came  to  it,  there  was  no  time 
for  anything  but  a makeshift.  Thus,  we 
failed  to  construct  an  adequate  standard  for 
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evaluating  our  work,  and  at  the  end  are  left 
speculating  in  the  valley  of  uncertainty." 
(The  OSS  Assessment  Staff,  1948,  p.  448) 


3.3.3  Research  During  and  Immediately  Follow- 
ing the  Korean  Conflict  - Seeking  to  identify 
factors  related  to  the  success  or  failure  of 
infantrymen  in  combat  and  to  establish  hypotheses 
about  possible  predictors  of  combat  success, 
Edgerton  and  Graham  (1951)  embarked  on  a broad 
based  research  project.  They  surveyed  numerous 
historical  documents  for  statements  descriptive  of 
combat  behavior.  In  addition,  combat  seasoned 
Marines  and  Army  infantrymen  were  interviewed.  The 
interviews  and  literature  search  yielded  about  1100 
statements  describing  combat  behavior  from  which 
Edgerton  and  Graham  developed  a forced  choice 
rating  instrument. 


Edgerton  and  Graham  (1951)  originally  planned 
to  validate  their  selection  instrument  on  inter- 
mediate criteria  based  upon  training  performance; 
but  with  the  outbreak  of  fighting  in  Korea,  they 
sought  a good  combat  criterion.  Not  having  a prac- 
ticable objective  criterion  of  contoat  success, 
Edgerton  and  Graham  settled  for  a tentative  crite- 
rion. That  criterion  consisted  of  soldiers  naming 
fellow  squad  members  with  whom  they  would  (favor- 
able) or  would  not  (unfavorable)  like  to  enter 
combat.  Ratings  for  927  Korean  veterans  were 
provided  by  569  respondents. 


Descriptions  of  favorably  nominated  soldiers 
tended  to  focus  on  leadership,  social  behavior, 
intelligence,  and  alertness,  whereas  descriptions 
of  unfavorably  nominated  soldiers  tended  to  focus 
on  their  reactions  under  fire  or  their  lack  of 
physical  capacities. 


Edgerton  and  Graham  (1951)  had  outlined  plans 
for  cross  validation  of  their  forced  choice  selec- 
tion instrument,  but  were  unable  to  complete  that 
work.  Other  scientists  within  the  Army  personnel 
research  community  continued  this  class  of  research. 


Three  major  Army  selection  research  programs 
were  conducted  in  Korea.  First  was  that  of  the 
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Personnel  Research  Branch  of  the  Adjutant  General's 
Office  which  relied  heavily  on  NCO  ratings  of  com- 
bat effectiveness.  Second  was  that  of  the  Opera- 
tions Research  Office  (ORO)  of  Johns  Hopkins 
University  which  focused  on  physiological  stresses 

associated  with  combat.  The  ORO  work  (Davis  , 1952) 
however,  does  not  fit  in  the  mainline  of  the  present 
research.  Third  was  the  research  effort  by  the 
HumRRO  team  which  used  a peer  nomination  technique. 


Prior  to  the  Personnel  Research  Branch  (PRB) 
effort  during  the  Korean  conflict,  research  in  a 
ground  combat  zone  had  generally  been  considered 
impracticable  (King,  Campbell,  Johnson,  Klieger, 
and  Yaukey,  1952).  The  PRB  investigators  sought 
actively  to  conduct  research  where  face-to-face 
contact  with  those  experiencing  infantry  combat  was 
possible.  Aside  from  generating  the  specific  data 
about  the  nature  of  the  combatants,  the  PRB  program 
demonstrated  effectively  that  research  near  the 
front  lines  is  possible.  King,  et  aj[,  noted  that. 


"...  one  definite  and  important  conclusion 
can  already  be  stated  concerning  the  accom- 
plishments of  these  studies  as  a whole. 
Success  in  obtaining  the  research  data  has 
demonstrated  that  profitable  personnel 
research  can  be  conducted  in  a combat  setting 
with  a minimum  of  inconvenience  to  military 
operations."  (1952,  p.iii) 


Using  ratings  obtained  from  superior  officers. 
King,  ^ aj[,  (1952)  sought  to  examine  the  possible 
link  between  performance  at  West  Point  and  rated 
combat  effectiveness.  When  43  company  grade  offi- 
cers who  were  academy  graduates  were  studied, 
relatively  high  validity  coefficients  were  noted. 
The  best  of  the  15  predictors  considered  was  the 
Aptitude  for  Service  Rating  (r  = .52)  which  was 
assigned  during  the  senior  year  at  West  Point. 


The  Officer  Efficiency  Report  (OER)  score  for 
service  in  the  combat  zone  served  as  the  criterion 
of  contiat  effectiveness  for  Katz,  Burke,  and  King 
(1955).  Those  researchers  studied  a sample  of  90 
company  grade  officers  who  were  graduates  of 
Infantry  Officer  Candidate  School  (OCS)  in  1951. 
Peer  rankings  in  OCS  yielded  the  highest  predictive 
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relationship,  r = .34;  academic  grades  in  OCS  were 
of  little  value,  r = -.05  to  -.01.  Peer  rankings 
were  very  useful  in  another  study.  Wilkins  (1954) 
indicated  that  the  best  predictor  of  how  a Marine 
platoon  leader  in  combat  will  be  judged  for  effec- 
tiveness by  his  superior  is  the  estimate  of  his 
fellow  candidates  before  he  is  commissioned. 

Johnson,  Burke,  Loeffler,  and  Drucker  (1955) 
studied  the  5th  Cavalry  Regiment  and  35th  Infantry 
Regiment  in  Korea  in  1951  and  developed  a combat 
self-description  blank  on  which  soldiers  answered 
multiple  choice  items  about  biographical  informa- 
tion and  indicated  preferred  personal  characteris- 
tics. A modified  version  of  this  self-description 
blank  was  used  in  other  studies  by  PRB  researchers. 
Haggerty,  Johnson,  and  King  (1959)  were  able  to  use 
"Mail-order"  ratings  to  get  combat  performance 
estimates  for  West  Point  graduates. 

Near  the  end  of  1953,  the  PRB  initiated 
research  to  identify  the  most  promising  of  a large 
number  of  new  experimental  combat  predictors  and  to 
validate  those  predictors  in  a longitudinal  study 
involving  approximately  4000  soldiers.  Before  this 
longitudinal  work  was  undertaken,  the  discrepancy 
between  intermediate  and  ultimate  criteria  was  care- 
fully considered  by  the  PRB  group.  Willemin, 
Rosenberg,  and  White  (1957)  believed  that  inter- 
mediate criteria  could  augment  the  "in  war"  research. 
Discussing  this,  Willemin,  Rosenberg,  and  White 
stated, 

"The  ultimate  criterion  to  use  in  validating 
potential  combat  selection  tests  is  one 
collected  at  the  front  lines.  Nevertheless, 
research  on  combat  selection  was  continued 
long  after  the  Korean  hostilities  ceased 
because  it  was  firmly  believed  that  criteria 
derived  in  carefully  selected  training  an  I 
maneuver  situations  could  materially  supple- 
ment a front  line  criterion.  Although 
elements  of  stress  and  realistic  danger. 
Including  the  'will  to  fight,'  are  more 
readily  tapped  in  the  combat  situation,  non- 
combat tactical  situations  may  provide 
sampling  of  characteristics  not  easily 
measured  in  combat."  (1957, p.  1) 

The  most  promising  predictors  found  in  the 
longitudinal  studies  have  since  been  incorporated 
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into  the  Anny's  combat  arms  aptitude  tests  (Helme, 
1974).  After  the  longitudinal  study  was 
outlined,  variables  were  selected  and  then  sepa- 
rately validated  on  intermediate  criteria  for  each 
of  the  four  combat  arms  branches,  infantry,  armor, 
combat  engineers,  and  artillery  (e.g.,  Birnbaum, 
Rosenberg,  White,  and  Willemin,  1957;  Birnbaum, 
White,  Rosenberg,  and  Willemin,  1957a). 

The  development  of  potentially  useful  percep- 
tual, psychomotor,  and  reasoning  tests  for  use  in 
the  PRB  studies  was  performed  by  Willemin  and 
Rosenberg  (1957a).  Since  it  was  a developmental 
step,  the  Willemin  and  Rosenberg  work  used  inter- 
mediate criteria  in  the  form  of  Combat  Aptitude 
Ratings  which  required  an  estimate  of  combat 
potential  and  a rank  ordering  of  squad  members  in 
an  advanced  combat  training  environment.  These 
preliminary  efforts  identified  several  predictors. 
Descriptions  of  the  more  widely  used  PRB  predictors 
(e.g..  Attention  to  Detail  Test  or  Weapons  Identi- 
fication Test)  are  included  in  Appendix  3.B.  Those 
descriptions  might  be  useful  in  interpreting 
portions  of  Figure  3.3-2. 

When  evaluating  the  Korean  studies  of  the  PRB 
group  and  the  HumRRO  team  in  an  attempt  to  refine 
the  newly  defined  directions  in  the  Army  selection 
research,  Willemin,  Birnbaum,  and  Rosenberg  (1957a) 
noted  that,  ".  . . the  best  results  fo-  efficient 
combat  classification  were  most  likely  to  come  from 
measuring  not  only  technical  skills  and  abilities 
but  also  such  factors  as  personality,  motivation, 
interest,  and  attitudes  (p.  1)."  The  Willemin, 
Birnbaum,  and  Rosenberg  evaluation  resulted  in  the 
selection  of  16  predictor  instruments  for  use  in  a 
longitudinal  study  of  infantrymen.  The  coeffi- 
cients for  the  Willemin,  Birnbaum,  and  Rosenberg 
(1957b)  study  which  are  reported  in  Figure  3.3-2 
tend  to  be  positive  and  around  .20.  The  strongest 
coefficients,  besides  the  fifth  week  predictor 
(peer)  ratings  which  yielded  an  r of  .57,  were 
Arithmetic  Reasoning,  .34;  Reaction  to  Signals, 

.33;  and  the  General  Information  Test,  .33.  One  of 
the  conclusions  of  the  infantry  validation  study 
conducted  in  the  United  States  was  that  personality 
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factors  added  substantially  to  the  selection 
package. 

The  preliminary  validation  studies  performed 
in  the  United  States  for  other  combat  specialties 
showed  minor  differences  from  the  preliminary 
infantry  validation  study.  For  all  four  combat 
specialty  areas,  the  strongest  predictor  was  the 
peer  rating  taken  during  the  fifth  week  of  train- 
ing (Willemin  and  Rosenberg,  1957b;  Birnbaum,  White, 
Rosenberg,  and  Willemin,  1957a,  1957b;  Birnbaum, 
Rosenberg,  White,  and  Willemin,  1957). 

Most  of  the  troops  studied  in  the  United 
States  were  also  studied  in  overseas  maneuvers  one 
year  later.  Willemin,  Birnbaum,  Rosenberg,  and 
White  (1957)  reported  validity  coefficients  based 
upon  an  intermediate  criterion  which  was  the  combat 
aptitude  rating  administered  in  overseas  maneuvers. 
These  coefficients  appear  in  a column  near  the  right 
of  Figure  3.3-2.  The  overseas  validity  analyses 
were  very  much  in  agreement  with  the  earlier  state- 
side analyses.  Although  the  absolute  value  of  the 
coefficients  was  somewhat  lower  in  the  overseas 
study,  the  two  instruments  which  appeared  to  have 
the  greatest  generalized  validity  in  the  overseas 
analyses  were  the  personality  questionnaire  and 
the  General  Information  Test. 

At  the  conclusion  of  the  seven-year  PRB  effort 
to  improve  the  Army  Classification  Battery,  which 
had  included  the  study  of  approximately  1000 
soldiers  in  Artie  maneuvers,  2000  in  Korean  combat, 
and  2000  in  peacetime,  some  firm  conclusions  could 
be  appropriately  drawn.  Most  important  were:  (1) 
the  need  for  the  inclusion  of  personality  material 
in  combat  arms  selection  batteries,  and  (2)  the  need 
for  interest  area  information  in  the  selection 
batteries  (Willemin  and  Karcher,  1958).  The  latter 
appeared  most  pertinent  for  "Masculine  Interests." 
The  data  reported  for  the  Willemin  and  Karcher  study 
(study  20  in  Figure  3.3-2)  are  in  some  cases 
partially  redundant  with  earlier  PRB  reports,  but 
the  study  incorporates  some  of  the  HumRRO  data. 

The  new  batteries  were  tried  out  on  1500  new 
recruits,  and  these  tests  were  shown  to  be  useful 
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in  improving  the  overall  classification  of  personnel 
(Willemin,  Mellinger,  and  Karcher,  1958). 

The  largest  single  research  effort  on  infan- 
tryman performance  was  that  by  Egbert,  Meeland, 
Cline,  Forgy,  Spickler,  and  Brown  (1957)  in  the, 
so  called.  Fighter  I program.  These  HumRRO 
researchers,  under  contract  to  the  Department  of 
the  Army,  sought  to  develop  psychological  descrip- 
tions of  fighters  and  nonfighters  who  served  in 
Army  combat  units  in  the  Korean  conflict.  If  an 
adequate  set  of  descriptors  could  be  developed, 
then  these  could  serve  as  aids  in  the  development 
of  Army  selection  devices. 

Egbert,  it  al^.  (1957)  studied  very  good  combat 
performers  in  hopes  of  more  readily  identifying 
differentiating  traits.  Six  hundred  and  forty- 
seven  soldiers  from  the  45th,  2nd,  and  7th  infantry 
Divisions  were  interviewed  during  the  summer  of 
1953  and  asked  to  identify  two  or  three  soldiers 
they  would  most  and  least  want  to  fight  alongside 
and  to  describe  incidents  from  combat  that  led 
to  those  selections.  The  interviewees  were  told 
that  they  were  being  asked  to  provide  this  informa- 
tion so  that  it  could  be  used  for  preparing  others 
for  combat.  From  the  interview  data,  310  infantry- 
men were  selected.  They  were  adminstered  a 40-hour 
battery  of  tests  in  Korea  in  the  fall  of  1953.  To 
be  in  the  upper  criterion  group,  one  had  to  be 
cited  as  a good  performer  by  two  or  more  inter- 
viewees, or  he  had  to  be  cited  by  one  interviewee 
and  also  be  recommended  for  a decoration  for  valor 
in  combat.  Lower  criterion  group  members  either 
were  selected  as  poor  performers  by  interviewees 
or  classed  themselves  as  inadequate  performers. 

Egbert,  et  a^,  (1957)  were  acutely  aware  that 
interviewer  bias  and  experimenter  bias  could  dis- 
tort their  findings,  but  the  use  of  data  only  from 
the  extrene  performers  served  to  reduce  this.  The 
40-hour  test  battery  yielded  several  hundred 
variables  on  which  the  two  criterion  groups  were 

'Other  related  studies  coming  out  of  the  PRB 
include  Miller  (1953);  Lybrand,  Cohen,  Kassebaum, 
McGrath,  and  Molnar  (1954a,  1954b). 
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compared.  The  predictors  evaluated  by  Egbert, 
et  were  quite  often  very  obscure  and  too  numer 
ous  to  include  reasonably  with  other  studies  in 
Figure  3.3-2.  They  are  included  in  Appendices  3.C 
and  3.D  and  are  considered  not  only  a valuable 
augmentation  of  the  data  in  Figure  3.3-2  but  a 
reflection  of  one  of  the  most  thorough  evaluations 
of  predictor  variables  with  potential  for  disting- 
uishing the  combat  effective  from  the  ineffective. 


Following  extensive  analyses,  Egbert,  et  al , 
(1957)  summarized  their  findings  with  the  'ollowing 
11  statements: 


The  fighter  has  greater  emotional  stability. 


a. 

The  fighter 

b. 

The  fighter 

c. 

The  fighter 

d. 

The  fighter 

e. 

The  fighter 

f. 

The  fighter 

9- 

The  fighter 

h. 

The  fighter 

i . 

The  fighter 

j- 

The  fighter 
knowledge. 

k. 

The  fighter 

accuracy  on 

During  the  1960s  HumRRO  undertook  an  analysis 
of  behavior  under  stress.  Kern  (1966)  proposed  that 
an  individual's  stress  resistance  is  related  to  his 
confidence  in  a particular  situation  or  situational 
test.  Boyles  (1968)  used  Situational  Confidence 
Measures  with  a Background  Activities  Inventory  to 
evaluate  confidence  at  various  points  in  helicopter 
training.  Situational  confidence  appears  to  be  a 
potentially  useful  concept  for  describing  one  area 
of  the  combatant's  performance. 

Katter  and  Holmon  (1954),  working  for  HumRRO, 
performed  research  to  determine  which  evaluation 
devices  used  in  Infantry  OCS  were  useful  in  pre- 
dicting the  future  performance  of  junior  officers 
in  combat  units.  The  goal  of  this  work  was  to 
identify  screening  devices  which  could  be  used  to 
improve  the  combat  effectiveness  of  Infantry 
officers.  Three  pre-OCS  measures  and  eight  measures 
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taken  during  OCS  were  correlated  with  OCS  class 
standing  and  with  combat  performance  in  Korea  as 
reflected  in  combat  ratings.  Detailed  comments 
provided  by  the  commanding  officers  (OER)  of  139 
Infantry  OCS  graduates  were  used  to  rate  their 
effectiveness.  Additional  ratings  were  obtained 
for  120  OCS  graduates  serving  in  the  45th  Division. 
The  11  measures  and  their  correlations  with  the 
two  criteria  are  shown  in  Figure  3.3-3.  The 
entries  in  the  "correlation  with  combat  performance" 
column  are  redundant  with  entries  from  the  Katter 
and  Holmon  study  appearing  in  Figure  3.3-2. 
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PREDICTERS 

CORRELATION 
WITH  FINAL  OCS 
CLASS  STANDING* 

CORRELATION 
WITH  COMBAT 
PERFORMANCE 

OCS  MEASURES 

STUDENT  RATING 

0,61 

0.20 

COMPANY  COMMANDER  RATING 

0.7S 

0.20 

PLATOON  LEADER  RATING 

0.63 

047 

FINAL  CLASS  STANDING 

- 

0.1S 

DEMERITS 

0,29 

0.07 

Ml  RIFLE  QUALIFICATION  CATE- 

GORY 

0.10 

0.0S 

PHYSICAL  EFFICIENCY  TEST 

OUM 

0.04 

ACADEMIC  STANDING 

0J6 

0.02 

PRE-OCS  MEASURES 

AGE 

0.03 

-0.01 

EDUCATION 

0.06 

-0.01 

AAI  AND  OCT 

0.20 

-0.09 

•AN  AVERAGE  OF  STUDENT  RATING,  COMPANY  COMMANDER  RATING.  AND 
ACADEMIC  STANDING. 


FIGURE  3,3-3  CORRELATIONS  BETWEEN  OCS  RATINGS 
AND  COMBAT  PERFORMANCE  (After  Katter  & Holmon,  1954) 


Of  special  interest  here  is  a comparison  of 
the  two  columns  of  Figure  3.3-3.  The  correlations 
between  the  predictors  and  the  combat  ratings  are 
generally  lower  than  those  between  the  predictors 
and  success  in  OCS.  A striking  difference  exists 
between  the  two  criteria  and  their  relationship 
with  academic  standing.  Of  course,  academic  stand- 
ing is  one  of  the  determiners  of  final  class 
standing,  so  the  .86  correlation  between  the  two 
is  inflated.  Nevertheless,  a large  difference 
exists  in  the  correlations  between  academic  stand- 
ing and  the  two  criteria.  Academic  standing  in  OCS 
was  not  shown  to  predict  combat  performance. 
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Torrance  and  Ziller  (1957)  drew  upon  the  find- 
ings of  Torrance,  Rush,  Kohn,  and  Doughty  (1957) 
and  the  HumRRO  work  (Egbert,  et  aj^,  1957)  which  had 
illustrated  the  importance  of  risk-taking  to  combat 
effectiveness  and  tried  to  validate  a risk-taking 
scale  of  a biographical  inventory.  The  subjects  in 
this  study  were  370  combat  aircrew  personnel,  yet 
this  stressful  combat  surrogate  did  not  involve 
combat  aviation.  The  intermediate  criteria  were 
four  measures  derived  from  a test  given  in  the 
Advanced  Survival  Course.  The  test  consisted  of  < 

nine  problem-solving  field  test  situations  under  I 

threat  of  "punishment"  fot  wrong  choices.  The  I 

four  measures  were  Test  Risk,  the  total  number  of  ( 

high  risk  choices;  Verbalized  Risk,  the  frequency  i 

of  expressed  willingness  to  experience  the  more  i 

dangerous  alternative;  Perceived  Risk,  based  upon  r 

specific  item  choices;  and  Required  Odds,  a measure  t 

of  the  percentage  of  minimum  chance  of  success 
required  by  a subject  before  he  would  select  the  I 

most  dangerous  alternative.  "Individuals  scoring  < 

high  on  the  Risk  Scale  tended  to  take  more  risks  on 
tests  by  guessing,  to  perceive  less  risk  in  accom- 
plishing dangerous  tasks,  and  to  require  lower  odds 
in  choosing  a dangerous  alternative  than  do  indivi- 
duals scoring  low  on  the  scale."  (Torrance  and 
Ziller,  1957,  p.  5) 

Himelstein  and  Blaskovics  (1960)  developed  a 
risk  scale  for  a biographical  data  blank  and  found 
that,  for  Array  ROTC  cadets,  the  scale  was  useful 
for  indicating  an  intermediate  criterion  of  combat 
effectiveness. 

3.3.4  More  Recent  Work  - In  an  attempt  to 
identify  characteristics  of  those  who  are  unwilling 
to  perform  adequately  or  unable  to  perform  because 
of  disciplinary  problems,  Dubuisson  and  Klieger 
(1964)  analyzed  data  collected  during  the  Korean 
war  to  determine  if  a relationship  existed  between 
combat  performance  and  court-martial  convictions.  1 

For  this  restricted  sample,  the  relationship  between  I 
various  predictors  and  combat  ratings  are  included 
in  Figure  3.3-2.  The  relationship  between  the 
combat  rating  and  an  honorable  discharge  was  signi- 
ficant for  enlistees.  This  supported  the  belief 
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that  the  nonoffender  is  a better  combat  soldier. 

This  also  indirectly  refutes  the  often  believed 
notion  that  many  characteristics  associated  with 
the  stereotypical  convict  are  also  the  character- 
istics of  the  combat  fighter;  it  is  actually  the 
other  way  around. 

In  a study  using  "Field"  observational  tech- 
niques, Peres  (1959)  identified  several  character- 
istics to  be  tested  in  fighter  prediction.  Peres 
entered  a high  stress  environment,  the  U.S.  Army 
Ranger  Course,  as  a participant  observer.  Having 
kept  a detailed  record  of  his  observations  and 
experiences,  he  specified  ten  constellations  of 
reactions  which  might  have  potential  for  differen- 
tiating good  and  poor  fighters.  These  are 
malingering,  lack  of  social  responsibility, 
martyrdom,  unauthorized  withdrawal , hostility, 
fear  of  injury,  uneasiness  over  the  unknown, 
psychotic- like  reactions,  failure  to  assume  the 
combat  role,  and  inability  to  follow  instructions. 

Helme,  et  al^,  (1974)  of  the  Army  Research 
Institute  have  recently  attempted  to  develop 
measures  predictive  of  leadership  performance  in 
combat  and  have  validated  those  measures  prelimi- 
narily against  a set  of  situational  criterion  tasks 
designed  to  reflect  a combat  environment.  These 
researchers  developed  the  Differential  Officer 
Battery  (DOB)  which  included  measures  of  informa- 
tion ranging  from  military  tactics  and  technology 
to  physical  sciences,  social  sciences,  arts,  and 
sports.  Also  included  were  life  inventory  questions. 
The  eight  factors  for  the  DOB  which  appeared  to  be 
the  most  important  for  leadership  in  the  Helme, 
et  ai,  (1974)  study,  in  order  of  importance,  are 
(1)  general  knowledge,  (2)  mechanical  technology, 

(3)  scientific  potential,  (4)  combat  leadership, 

(5)  administration,  (6)  managerial  control, 

(7)  personal  adjustment,  and  (8)  organized  sports. 
Predictor  (DOB  scale)  correlations  with  Officer 
Evaluation  Center  performance  measurements  appear 
in  Figure  3 3-2. 
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3.3.5  Suitiitiary  and  Evaluative  Comitients  - We 
have  reviewed  the  nonaviation  combat  and  the  combat 
surrogate  studies.  The  review  reveals  that  the 
Army  has  done  substantially  more  research  pertain- 
ing to  selection  for  conbat  effectiveness  than  the 
other  services.  The  data  indicate  that  selecting 
for  specific  combat  duties  can  be  done  which,  in 
turn,  improves  force  readiness.  It  was  also  found 
that  peer  and  superior  ratings  augment  other  selec- 
tion methods  quite  well. 

The  nonaviation  combat  effectiveness  studies, 
then,  have  directly  addressed  basic  selection  prob- 
lems which  have  not  been  seriously  considered  for 
fighter  pilot  selection  since  the  Korean  conflict. 
The  selection  work  conducted  by  the  Army  research 
community  provides  substantial  data  of  value  in 
developing  a fighter  pilot  combat  effectiveness 
selection  program. 


I 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


3 . 4 FIXED  MING  PILOT  SELECTION  STUDIES  FOR  THE 
PREDICTION  OF  SUCCESS  IN  TRAINING 

Since  the  advent  of  World  War  II,  a large  num- 
ber of  studies  has  been  conducted  with  the  goal  of 
identifying  factors  important  in  the  prediction  of 
success  in  military  aviation  training.  From  some 
800  titles  and  abstracts  reviewed,  approximately 
200  articles  focusing  upon  pilot  selection  tech- 
niques were  chosen  for  discussion  in  this  report. 
Although  studies  related  to  nonpilot  or  nonaviation 
specialties  such  as  officer  effectiveness',  pilot 
instructor  proficiency^,  and  ROTC/academy  success^ 
were  also  reviewed,  this  research  will  not  be  dis- 
cussed due  to  its  limited  potential  value  for  the 
prediction  of  pilot  training  success. 

Pilot  selection  studies  are  of  two  major  types, 
rotary  wing  research,  and  fixed  wing  research. 
Statistical  results  of  rotary  wing  research  are 
summarized  in  Appendix  3.E.  Most  of  the  studies 
reviewed  are  of  the  fixed  wing  type.  These  include 
studies  done  within  the  United  States  Air  Force, 
Navy,  and  Army,  and  within  foreign  and  private 
pilot  programs  dating  from  World  War  II  to  the  pres- 
ent time. 

Although  a large  variety  of  criteria  for  suc- 
cess in  training  has  been  employed,  a dichotomous 
pass-fail  type  of  measure  has  been  favored.  Among 
these  are: 

1.  Pass-Fail/Attrite  (frequently  defined  as 
pass  versus  elimination  due  to  flight  de- 
ficiency, fear,  or  own  request;  elimina- 
tions for  physical  or  administrative  rea- 
sons are  sometimes  also  included  in  the 
fail/attrite  category) 

2.  Administrative  Elimination'* 

3.  Airsickness  Elimination'* 

4.  Fear  of  Flying  Elimination'* 

5.  Flight  Failure  Elimination'* 

6.  Medical  Elimination'* 

7.  Motivational  Elimination  (fear  of  flying 
and  voluntary  withdrawal  eliminations)'* 


commomMTiOM 


8.  "Not  Aeronautically  Adapted"  Elimination 
(Hutchins,  1964)'* 

9.  "Not  Physically  Adapted"  Elimination 
(Hutchins,  1964)“* 

10.  "Purified  Pass-Fail"  (graduated  from 
training  and  "good  adjustment"  versus 
failure  due  to  "poor  motivation,  exces- 
sive emotional  reaction  or  overt  symptoms 
attributable  to  stress  in  the  program," 
Sells,  1956) 

11.  Tension  Elimination  (anxiety)** 

12.  Tension  or  Airsickness  Elimination** 

13.  Voluntary  Withdrawal  Elimination** 

14.  Voluntary  Withdrawal  or  Flight  Failure 
El  imination** 

15.  Voluntary  Withdrawal  versus  Flight  Failure 
El imination. 

Less  frequently  used  criteria  are  criterion  group 
membership  (student  versus  instructor,  aviation 
officer  candidate  versus  college  student;  aviation 
officer  candidate  versus  drop  on  request,  adjusted 
versus  maladjusted,  and  type  of  aircraft  or  pilot 
assignment),  number  of  board  appearances,  frequency 


'Barron,  Block,  MacKinnon,  et  (1958);  Gough 
(1958);  Gough  and  Krauss  (1958TT  Hollander  (l964); 
Lichtenstein  and  Hahn  (1962);  MacKinnon  (1958); 
MacKinnon,  Crutchfield,  Barron,  et  al , (1958); 
Suttell  (1955);  Thorndike  and  HagenTl958);  Tupes 
(1957a);  Tupes  (1957b);  Tupes  (1959);  Tupes  (1963); 
Tupes  and  Christal  (1957);  Tupes,  Carp  and  Borg 
(1957);  Vinacke  (1956);  Wherry,  Stander  and  Hopkins 
(1959);  Woodworth  and  MacKinnon  (1957);  Woodworth 
and  MacKinnon  (1958);  Woodworth,  Barron  and 
MacKinnon  (1957). 

^Cox  and  Christal  (1956);  Gallagher  (1958); 
Johnson  and  Berkshire  (I960);  Mulljns  and  Cox 
(1959);  Tucker  (In  Perry,  1967). 

'Creager  and  Miller  (1960);  Krumboltz  (1957); 
Miller  (1960a);  Miller  (1960b);  Miller  (1961); 
Miller  and  Creager  (1960);  Tupes  and  Kaplan  (1961b). 

■* These  groups  are  contrasted  with  all  other 
candidates  or  successful  candidates.  For  example, 
the  Administrative  Elimination  Criterion  refers  to 
Pass/Other  versus  Administrative  Elimination. 
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of  airsickness  and  vertigo  experiences,  grades 
(academic,  flight,  military,  and  overall),  military/ 
leadership  rank,  motivational  measures  (e.g.,  desire 
to  enter  pilot  training),  stage  of  attrition,  and 
time  to  solo  or  complete  training. 

In  addition  to  the  criterion  used,  studies 
have  also  been  organized  by  the  type  of  predictor 
employed.  At  a general  level,  predictors  may  be 
classified  into  two  types:  (1)  those  dealing  with 

characteristics,  e.g.,  general  aptitudes,  traits; 
and  (2)  those  dealing  with  critical  skills  for 
piloting  proficiency,  e.g.,  performance  on  job 
samples  and  light  planes. 

Correlation  (r)^  and  multiple  correlation  (R)** 
have  been  the  most  popular  statistics  employed. 
Statistical  tests  used  are  t^,  F^,  and  x^®. 

Reviews  of  research  focusing  on  characteris- 
tics, critical  skills,  and  multiple  prediction  are 
presented  in  Sections  3.4.1,  3.4.2,  and  3.4.3, 
respectively.  Caution  should  be  exercised  in 
interpreting  this  literature,  especially  in  cases 
where  repeated  statistical  testing  is  found.  This 
statistical  problem,  as  well  as  methodological 
issues,  is  discussed  in  Section  3.4.4.  Summary 
statements  may  be  found  at  the  end  of  each  subsection 
as  well  as  in  Section  3.4.5. 

3.4.1  Characteristics  - Included  in  this  cate- 
gory are  aptitude,  biographical,  medical,  motiva- 
tional, personality,  stress,  and  social  factors. 
Relationships  between  these  predictors  and  the  cri- 
teria noted  previously  (Section  3.4)  are  reviewed 
in  Sections  3. 4. 1.1  through  3. 4. 1.7. 

3. 4. 1.1  Aptitude  Factors  - Studies  using 
aptitude  measures  as  predictors  of  success  in  train- 
ing are  summarized  in  Figure  3.4-1.  Included  in 
this  figure  are  those  studies  which  have  reported 
statistical  results.® 

During  World  War  II,  the  Army  Air  Force's 
Psychology  Program  was  established  to  develop  a 
full-scale  program  for  the  selection  of  aircrew 
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personnel.  Under  this  program,  two  testing  instru- 
ments, largely  consisting  of  aptitude  material, 
were  devised.  One  of  these  was  the  Army  Air  Force's 
Qualifying  Examination  (AAFQE)  which  was  used  as  a 
preliminary  screening  device.  This  exam  included 
tests  for  comprehension  and  judgment,  mathematical 
ability,  mechanical  comprehension,  and  observational 
judgment  (DuBois,  1947;  Flanagan,  1948;  Miller, 
1947).  One  of  the  best  sources  of  validity  data  for 
the  AAFQE  is  provided  by  a study  done  with  approx- 
imately 1300  unselected  men  sent  into  pilot  training 
during  World  War  II. These  trainees  were  tracked 
through  advanced  training.  Correlations  of  .46 
(mechanical  comprehension)  and  .50  (composite)  were 
reported  using  the  pass-fail  criterion  (DuBois, 

1947;  Flanagan,  1948). 

Another  major  development  during  World  War  II 
was  the  Aircrew  Classification  Battery  (ACB).  This 
instrument  was  used  for  the  classification  of  air- 
crew into  specialties  such  as  navigator,  bombardier, 
and  pilot  (DuBois,  1947;  Flanagan,  1948;  Miller, 
1947).  In  addition  to  individual  test  scores, 
stanines"  were  also  obtained.  In  the  study  with 
1300  unselected  men  sent  into  pilot  training,  corre- 
lations ranged  from  .29  to  .49  for  the  individual 
tests  using  the  pass-fail  criterion.  Correlations 


5The  degree  of  relationship  between  a predictor 
and  a criterion  (correlation  coefficient). 

®The  degree  of  relationship  between  two  or  more 
predictors  (combined)  and  a criterion  (multiple 
correlation). 

^Tests  of  differences  between  means. 

®A  test  of  association  between  variables  con- 
sisting of  frequency  data. 

®In  the  research  reviewed,  the  predictors  were  not 
studied  in  combination  with  all  criteria.  Therefore, 
this  figure,  like  others  in  this  section,  contains 
empty  cells.  A slash  indicates  that  a range  of 
values  is  being  reported.  Significance  levels  are 
indicated  when  they  have  been  reported  by  the 
author(s).  Due  to  the  variety  of  statistics  employed 
and  the  large  number  of  studies  reviewed,  signifcance 
levels  were  not  computed  when  they  were  absent  from 
the  literature.  For  example,  several  types  of  corre- 
lations have  been  used  - the  Pearson  product-moment 
correlation,  Spearman  rank-order  correlation,  biserial 
correlation,  point-biserial  correlation,  and  phi. 

’®Pilot  trainees  who  had  not  been  screened. 

"Stanines  are  normalized  scores  with  a mean  cf 
five,  a standard  deviation  of  approximately  twn  and 
a range  of  1 to  9.  The  word  stanine  became  asso- 
ciated with  aircraft  specialty  tests,  but  has  sub- 
sequently been  used  generally. 
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FIGURE  3.4-1  STATISTICAL  RESULTS  OF  FIXED  WING  PILOT  SELECTION  STUDIES  RELATING  APTITUDE  MEASURES  TO  CRITERIA 
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for  the  bomba  richer,  navigator,  and  pilot  stanines, 
respectively,  were  .52,  .53.  and  .64  (DuBois,  1947; 
Flanagan,  19481.  Similarly,  high  correlations  have 
been  obtained  in  other  studies.  Using  the  pilot 
stanine,  Levine  and  Tupes  (1952)  found  correlations 
of  .57  with  the  pass-fall  criterion,  .49  with  the 
administrative  elimination  criterion,  .60  to  .63 
with  the  flight  failure  elimination  criterion,  and 
.24  to  .56  with  the  motivational  elimination  crite- 
rion in  basic  training.  Michael  (1949)  obtained 
correlations  ranging  from  .42  to  .60  with  the  pass- 
fail  criterion  in  training. 

Since  this  initial  major  effort,  several  other 
tests  with  aptitude  components  have  been  devised. 
Fairly  high  correlations  have  been  reported  for  the 
Flight  Aptitude  Rating  (FAR)  which  is  based  upon 
scores  for  mechanical  and  spatial  abilities. 
Berkshire  and  Ambler  (1963)  reported  correlations 
ranging  from  .05  to  .42  with  pass-fail  type  cri- 
teria and  .22  to  .40  with  grades  in  Naval  flight 
training.  Although  Martoccia  and  Kelly  (1957) 
failed  to  find  differences  in  FAR  scores  between 
voluntrary  withdrawal  and  flight  failure  elimina- 
tions, those  who  attrited  in  later  stages  of  train- 
ing (later  basic  and  advanced)  had  higher  FAR  scores 
than  those  who  attrited  earlier  (presolo). 

Promising  correlations  have  also  been  obtained 
with  two  Army  tests,  the  Army  Fixed  Wing  Aptitude 
Battery  (AFWAB)  and  the  Flight  Aptitude  Selection 
Test  (FAST).  For  the  AFWAB,  correlations  with  the 
pass-fail  criterion  ranged  from  .32  to  .41.  The 
correlation  with  the  flight  failure  elimination 
criterion  was  .32.  Similarly,  FAST  scores  had 
correlations  ranging  from  .39  to  .46  with  the  pass- 
fail  criterion  in  flight  training  (Kaplan,  1965). 

With  other  aptitude  test  measures,  mixed  re- 
sults have  been  reported.  One  of  these  tests  is 
the  Air  Force  Officer  Qualifying  Test  (AFOQT) 
(Miller,  1966b;  Miller,  1968;  Miller,  1970;  Miller 
and  Valentine,  1964;  Valentine,  1960).  This  test 
is  composed  of  13  subtests  from  which  five  com- 
posites are  computed.  These  are  the  pilot,  naviga- 
tor-technical, officer  quality,  verbal,  and  quanti- 
tative composites.  In  most  studies  reviewed,  fairly 
high  validity  coefficients  have  been  reported 


(flyer  and  Bigby,  1955a;  Miller,  1966a;  Miller, 

1359;  Mullins  and  Cox,  1960;  Tupes  and  Christal, 
1957;  Valentine,  1961)  using  both  pass-fail  type 
criteria  and  training  grades.  For  example.  Flyer 
and  Bigbee  (1955a)  reported  a correlation  of  .58 
between  the  pilot  composite  and  the  pass-fail  cri- 
terion through  basic  training;  and  Valentine  (1961), 
using  the  pilot  composite,  found  correlations  of 
.45  and  .51  with  the  pass-fail  criterion  and  the 
flight  failure  elimination  criterion,  respectively, 
in  primary  training.  Miller  (1969)  reported  sig- 
nificant correlations  ranging  from  .18  to  .48  using 
the  pilot  composite  and  grades  in  training.  Al- 
though the  majority  of  studies  have  reported  prom- 
ising validity  coefficients  for  the  AFOQT,  two 
studies  reviewed  have  reported  negative  findings. 
LeMaster  and  Gray  (1974)  investigated  the  relation- 
ship between  the  five  composites  and  two  criteria 
in  T-37  training  (pass-fail  and  flight  grades). 

Only  one  of  ten  correlations  reached  significance, 
and  this  correlation  was  negative.  HcGrevy  and 
Valentine  (1974)  computed  multiple  correlations 
between  AFOQT  scores  and  two  criteria  in  training 

A* 

(pass-fail  and  flight  failure  elimination).  Both 
correlations  failed  to  reach  significance. 

Other  aptitude  measures  which  have  yielded 
inconsistent  results  are  College  Entrance  Examina- 
tion Board  Scores  (Valentine,  1961),  and  scores  on 
the  Aviation  Cadet  Officer  Qualifying  Test  (Tupes, 
Bowles,  and  Torr,  1955),  the  Aviation  Qualifying 
Test  (Bale  and  Ambler,  1971;  Berkshire  and  Ambler, 
1963;  Fleischman,  Ambler,  Peterson,  and  Lane,  1966; 
Martoccia  and  Kelly,  1957),  Mechanical  Comprehen- 
sion Tests  (Bale  and  Ambler,  1971;  Fleischman, 
et  a_[,  1966;  Greene,  1947;  Lane,  1947;  Martoccia 
and  Kelly,  1957),  and  the  Self  Administering  Test 
of  Mental  Ability  (Greene,  1947;  Lane,  1947). 

In  summary,  substantial  correlations  have  been 
obtained  with  several  aptitude  measures.  These  are 
the  AAFQE,  the  ACB,  the  FAR,  the  AFWAB,  and  the 
FAST  battery.  The  highest  correlations  were  re- 
ported with  the  pilot  stanine  of  the  ACB  developed 
during  World  War  II. 
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3. 4. 1.2  Biographical  - Several  instruments 
have  been  devised  to  secure  biographical  informa- 
tion to  predict  success  in  training.  As  can  be 
seen  from  Figure  3.4-2,  this  type  of  measure  shows 
some  potential  for  predicting  training  success. 

Bale  and  Ambler  (1971)  and  Fleischman,  et  al . 
(1966)  have  related  scores  on  the  Biographical 
Inventory  to  measures  of  success  in  flight  training. 
Bale  and  Ambler  (1971)  obtained  a statistically 
significant  correlation  (r  = .14)  with  the  pass- 
fail  criterion.  Correlations  reported  by  Fleischman, 
et  (1966)  were  .15,  .13,  and  .10  with  the  pass- 
fail,  flight  failure  elimination,  and  voluntary 
withdrawal  elimination  criterion,  respectively. 

Many  test  batteries  also  contain  biographical 
components.  The  Aircrew  Classification  Battery 
included  two  biographical  scores:  (1)  Biographical 

Data:  Navigator,  and  (2)  Biographical  Data:  Pilot. 

In  an  unselected  sample  of  pilot  trainees  during 
World  War  II,  Biographical  Data:  Navigator  corre- 
lated .11  and  Biographical  Data:  Pilot  correlated 
.31  with  the  pass-fail  criterion  (DuBois,  1947; 
Flanagan,  1948). 

The  Air  Force  Officer  Qualifying  Test  contains 
i Pilot  Biographical  Inventory  and  an  Officer 
Quality  Biographical  Inventory.  Scores  on  the 
fohner  had  correlations  of  .18  to  .21  with  the 
pass-fail  criterion  and  .17  to  .24  with  the  flight 
failure  etimination  criterion  in  primary  and  basic 
training  (Valentine,  1961).  However,  the  Pilot 
Biographical  Inventory  had  low  correlations  with 
basic  training  grades  (r  = .00  with  academic  grades; 
r * .10  with  flight  grades).  The  Officer  Quality 
Inventory  had  consistently  low  correlations  with 
all  criteria  (r  = -.04  to  .09).  / 

/ 

I 

Included  in  the  Army  Fixed  Wing  Aptitude 
Battery  is  a Background  Inventory.  Correlations 
found  were  .15  to  .20  with  the  pass-fail  criterion 
and  .18  with  the  flight  failure  elimination  crite- 
tion  in  flight  training  (Kaplan,  1965). 

The  final  inventory  reviewed  is  the  ROTC 
Personal  Inventory.  Scores  on  this  test  were  found 
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to  be  unrelated  to  motivation  for  flying  training 
(application  for  pilot  or  aircraft  observer  train- 
ing) (Tupes,  et  aj[,  1955). 

Academic  grades  constitute  one  biographical 
variable  which  has  been  found  valuable  for  pre- 
dicting success  in  training.  Several  studies  have 
found  significant  relationships  between  preflight 
grades  and  training  criteria  (Booth,  1968; 
Fleischman,  et  al_,  1966;  Hollander,  1952; 

Martoccia  and  Kelly,  1957).  For  example, 
Fleischman,  et  al^,  (1966)  reported  statistically 
significant  correlations  ranging  from  .12  to  .18 
with  the  pass-fail  criterion  and  from  .13  to  .26 
with  the  flight  failure  elimination  criterion. 
Correlations  with  the  voluntary  withdrawal  elimin- 
ation criterion  were  not  significant  (r  = .04  to 
.07).  Additionally,  Hollander  (1952)  found  corre- 
lations ranging  from  .12  to  .49  between  grades  and 
pass-fail  in  basic  training. 

Undergraduate  Pilot  Training  (UPT)  grades  also 
predict  success  in  training  (Bale,  Rickus,  and 
Ambler,  1973;  Cooper,  Imaye,  Karre,  Robertson, 

Ryan,  and  Sakahara,  1976).  For  example.  Cooper, 
e_t  (1976)  obtained  a correlation  of  .30  with 

flight  grades  in  the  Replacement  Air  Unit.  Other 
grades  which  have  shown  relationships  to  training 
criteria  are  primary  academic  grades  (Peterson  and 
Pomarolli,  1966)  and  U.S.  Naval  Academy  grades 
(Ambler  and  Kiernan,  1963).  Finally,  two  types  of 
grades  demonstrated  little  promise  as  predictors 
of  success  in  training.  These  are  college  grade 
point  average  (Bale  and  Ambler,  1971)  and  military 
science  grade  (Tupes,  et  al^,  1955). 

A second  important  predictor  is  military  rank. 
Hutchins  (1964)  studied  the  relationship  of  rank 
of  incoming  officers  to  three  criteria:  (1)  pass- 

fail,  (2)  type  of  attrition  (ground  failure  elimin- 
ation, voluntary  withdrawal  elimination,  flight 
failure  elimination,  not  aeronautical ly  adapted 
elimination,  not  physically  adapted  elimination, 
and  other  elimination)  and  (3)  stage  of  attrition. 
Greater  attritions  occurred  among  higher  ranking 
officers,  primarily  with  respect  to  voluntary  with- 
drawal elimination.  No  differences  were  obtained 
with  the  third  criterion. 
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Procurement  source  also  appears  to  be  a valu- 
able predictor  of  succes  in  training  (Waag,  Shannon, 
and  Ambler,  1973,  Wherry  and  Hutchins,  1964).  For 
example,  Waag,  al^,  (1973)  studied  the  relation- 
ship between  two  procurement  sources  and  two  cri- 
teria; (1)  pass-fail,  and  (2)  presolo  training 
grades.  Procurement  sources  were  Aviation  Officer 
Candidates  (civilians)  and  Officers  under  Instruc- 
tion (commissioned  officers).  Significant  differ- 
ences were  obtained  withboth  criteria,  with  greater 
failures  and  lower  training  grades  for  the  officer 
group. 

Previous  flying  experience  is  a fourth  variable 
related  to  success  in  training  (Ambler,  1955;  Bale 
and  Ambler,  1971;  DuBois,  1947;  Flanagan,  1948). 

Bale  and  Ambler  (1971)  found  a moderately  low  but 
statistically  significant  correlation  between  pos- 
session of  a private  pilot's  license  and  the  pass- 
fail  criterion  in  flight  training  (r  = .11).  Sim- 
ilarly, during  World  War  II,  in  the  study  with  an 
unselected  sample  of  pilot  trainees,  a correlation 
of  .28  was  obtained  between  prior  flying  experience 
and  the  pass-fail  criterion  (DuBois,  1947;  Flanagan, 
1948). 

Other  biographical  variables  investigated,  but 


3.4. 1.3  Medical  - As  can  be  seen  in  Figure 
3.4-3,  studies  reviewed  in  this  domain  focused  upon 
physical  fitness  test  scores  as  predictors.*^ 
Overall,  these  scores  seem  to  be  unrelated  to  suc- 
cess in  pilot  training.  This  is  undoubtedly  due, 
at  least  in  part,  to  the  fact  that  there  is  a 
restricted  range  since  those  in  poor  health  have 
not  been  in  the  samples  studied. 

Graybiel  and  West  (1945)  investigated  the 
relationship  of  two  physical  proficiency  tests  to 
flight  grades  at  two  stages  of  training  (primary 
and  intermediate  stages).  These  tests  were  the 
Pack  Test  and  the  Composite  Fitness  Test.  None 
of  these  correlations  reached  significance 
(r  =.00  to  .09).  Similarly,  Tupes,  et  a^,  (1955) 
found  little  relationship  between  scores  on  the 
ROTC  Proficiency  Test  Battery  and  motivation  for 
flying  training  (r  = -.02  to  -.05).  Valentine 
(1961)  reported  low  negative  correlations  between 
the  Physical  Aptitude  Exam  scores  and  the  pass-fail 
criterion  in  primary  and  basic  training,  the  flight 
failure  elimination  criterion  in  primary  and  basic 
training,  and  academic  and  flight  grades  in  basic 
training  (r  = -.12  to  .00). 

Substantial  correlations  were  obtained  in  only 
one  study  reviewed.  Krumboltz  (1957)  found  signif- 


for  which  conflicting  findings  or  low  correlations 
have  been  reported,  are  age  (Bair,  1952;  DuBois, 
1947;  Flanagan,  1948;  Martoccia  and  Kelly  1957), 
education  (Bair,  1952;  DuBois,  1947;  Flanagan, 

1948;  Martoccia  and  Kelly,  1957),  college  major 
(Bale  and  Ambler,  1971;  Peterson  and  Lane,  1966), 
college  population  and  location  and  age  at  which 
the  candidate  became  motivated  to  fly  in  the 
military  (Bale  and  Ambler,  1971). 

In  summary,  biographical  inventories  appear  to 
show  promise  for  the  prediction  of  pilot  training 
success.  Variables  showing  relationships  with 
training  criteria  are  academic  grades,  military 
rank,  procurement  source,  and  previous  flying 
experience.  The  value  of  other  biographical  vari- 
ables such  as  age,  education,  and  college  major  for 
predicting  aviation  training  success  is  question- 
able. 
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leant  multiple  correlations  between  seven  physical 

fitness  predictors  (height;  weight;  medicine  ball 

throw;  pull  ups;  hop,  step,  and  jump;  hurdle  run; 

and  250  yard  shuttle  run)  and  a peer  rating  of 

leadership  (R  = .17  to  .36).  The  obvious  differ-  ' 

ence  in  this  study  as  contrasted  with  others  is 

the  criterion  measure  used.  Other  studies  have 

used  a pass-fail  type  of  criterion  or  grades  as 

measures  of  success  in  training. 

? 

In  conclusion,  these  data  suggest  that  physi-  ? 

cal  proficiency  measures  are  largely  unrelated  to  | 

many  criteria  of  success  in  training. 


’^Other  types  of  physical  tests  have  been  devel-  /| 

oped,  such  as  strength  and  cardiovascular  tests  | 

(Bender,  Kobes,  Salmon,  and  Pierson,  1965)  and  j 

electrocardiographic  stress  tests  (Smith,  1964a;  | 

Smith,  1964b).  In  addition,  tests  are  avail- 
able  for  the  detection  of  medical  anomalies  such  ,,1 

as  the  Wolff-Parkinson  White  Syndrome  (Smith,  i] 

1964c).  However,  these  studies  did  not  address  J 

the  validity  of  these  variables  for  success  in  fj 

training. 
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3. 4. 1.4  Motivation  - As  shown  in  Figure  3.4-4, 
one  of  the  more  popular  motivational  variables  has 
been  aviation/flying  interest.  The  relationship 
between  this  predictor  and  success  in  pilot  train- 
ing is,  in  some  cases,  strong. 

One  of  the  earliest  studies  concerned  with  the 
effect  of  motivation  on  aviation  training  success 
was  done  with  an  unselected  sample  of  pilot  train- 
ees during  World  War  II.  Three  interest  measures 
were  correlated  with  the  pass-fail  criterion 
(trainees  were  tracked  through  advanced  training). 
These  measures  were  Strength  of  Interest:  Bombar- 
dier, Strength  of  Interest:  Navigator,  and  Strength 

of  Interest:  Pilot.  The  correlations  obtained  were 

low,  ranging  from  -.05  to  .09  (OuBois,  1947). 
Negative  findings  were  also  obtained  by  Greene 
(1947)  and  Lane  (1947)  using  the  Desire  to  Fly 
Inventory.  Correlations  with  flight  grades  in 
flight  training  ranged  from  -.12  to  .21  in  the 
former  study  and  from  -.17  to  .42  in  the  latter 
study,  thus  showing  a great  deal  of  variability. 

Aviation/flying  interest  measures  used  in 
later  studies  show  more  promising  results.  In  a 
review  of  the  literature,  Sells  (1956)  reported  on 
two  inventories.  These  are  the  Aviation  Interest 
Key  and  the  Pilot  Opinionaire.  Both  of  these  inven- 
tories contain  items  relating  to  aviation  interest. 
Correlations  with  the  purified  pass-fail  criterion'^ 
ranged  from  .33  to  .41  with  the  Aviation  Interest 
Key  and  from  .11  to  .28  with  the  Pilot  Opinionaire. 
Tupes,  et  al^,  (1955)  related  three  attitude  survey 
measures  to  motivation  for  flying  training.  Corre- 
lations were  .29  with  the  Military  Attitude  Survey, 
.24  with  the  Flying  Attitude  Survey,  and  .32  with 
the  Attitude  Survey  (total  scores).  These  corre- 
lations were  significant  at  the  .01  level  of  con- 
fidence. Finally,  Valentine  (1961)  assessed  the 
validity  of  four  Air  Force  Officer  Qualifying  Test 
Interest  scores  using  several  criteria  (pass-fail 
and  flight  failure  elimination  in  primary  and 
basic  training,  academic  and  flight  grades  in  basic 
training).  Two  interest  scores.  Administrative 
Interest  and  Quantitative  Interest,  showed  little 
relationship  with  all  criteria  (r  = -.06  to  .09 
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and  -.02  to  .13,  respectively).  Flying  Interest 
scores  showed  correlations  of  .24  with  the  pass- 
fail  criterion  and  .29  with  the  flight  failure 
elimination  criterion  in  primary  training.  Sim- 
ilarly, Technical  Interest  Scores  correlated  .25 
with  both  of  these  criteria  in  primary  training. 
Both  of  these  interest  scores  showed  low  correla- 
tions with  all  criteria  in  basic  training  (r  = -.11 
to  .10  and  -.17  to  .08,  respectively). 

Another  type  of  interest  measure  which  has 
been  assessed  is  vocational  interest.  Using  the 
Kuder  Preference  Record  (KPR),  Rosenberg  and  Izard 
(1953)  found  a significant  difference  between 
voluntary  withdrawal  eliminees  and  successful 
cadets  in  five  interest  areas,  and  Voas  (1959) 
obtained  a significant  relationship  between  the 
KPR  and  the  pass-fail  criterion.  However,  in  the 
latter  study,  this  relationship  was  not  upheld  when 
mechanical  ability  differences  were  controlled. 

A second  type  of  motivational  variable  which 
has  been  evaluated  is  strength  of  needs.  One  test 
which  has  been  used  is  the  Test  of  Insight  which 
measures  the  strength  of  achievement  and  affilia- 
tion drives  (French,  1955;  French,  1956).  French 
(1956)  related  these  measures  to  several  peer 
ratings  (judgments  of  achievement  motivation, 
affiliation  motivation,  friendliness,  and  goal 
attainment).  Correlations  were  low  in  all  cases 
(r  = -.05  to  .05).  Negative  findings  were  also 
reported  by  Peterson,  Lane,  and  Kennedy  (1965) 
with  the  Edwards  Personal  Preference  Schedule 
(EPPS),  a test  which  assesses  the  strength  of  15 
needs.  Criteria  were  flight  failure  elimination, 
voluntary  withdrawal  elimination,  and  flight  fail- 
ure and  voluntary  withdrawal  elimination  combined. 
Only  2 of  45  correlations  reached  significance, 
results  well  within  chance  expectations. 

In  contrast  to  these  studies,  Bucky  and  Burd 
(1970)  used  a variant  of  the  need  assessment 


'^See  Sells'  (1956)  definition  and  Section  3.4. 
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variable  and  reported  positive  findings.  Voluntary 
withdrawal  eliminees  and  successful  candidates  were 
asked  to  state  how  optimistic  they  were  with  respect 
to  the  program's  ability  to  satisfy  their  needs. 
Maslow's  five  needs  were  employed  (physiological, 
safety  and  security,  social,  self-esteem,  and  self- 
actualization).  Successful  candidates  were  signif- 
icantly more  optimistic  with  respect  to  all  needs 
with  the  exception  of  physiological  needs.  Largest 
differences  appeared  with  the  need  for  self -actual- 
ization'**. Therefore,  it  appears  that  expectations 
with  regard  to  need  satisfaction  might  be  a valuable 
predictor  of  voluntary  withdrawal  elimination. 

The  prediction  of  voluntary  withdrawal  elimin- 
ation is  a problem  which  has  been  addressed  by  a 
number  of  studies  within  the  motivational  domain. 

As  noted  above,  "expectations  with  regard  to  need 
satisfaction"  seems  to  be  one  critical  variable 
(Bucky  and  Burd,  1970).  This  is  also  suggested  in 
a second  study.  Pomarolli  (1966)  gave  voluntary 
withdrawal  eliminees  from  basic  training  a question- 
naire containing  57  factors  which  potentially  relate 
to  the  decision  to  withdraw.  The  most  frequent 
items  checked  were:  (1)  losing  interest  in  the 

program;  (2)  not  deriving  satisfaction  from  the 
program;  and  (3)  disliking  flying.  The  relation- 
ship between  aptitude  and  achievement  level  is  a 
second  factor  which  was  reported  to  be  of  value  in 
isolating  voluntary  withdrawal  eliminations.  Doll 
(1971)  found  higher  voluntary  withdrawal  rates  in 
the  high  aptitude  - low  achievement  quadrant  than 
in  any  other  quadrant.  Factors  showing  little 
promise  for  the  prediction  of  this  type  of  elimin- 
ation were  strength  of  general  needs  as  assessed 
by  the  EPPS  (Peterson  et  al,  1965)  and  philosoph- 
ical and  religious  opinions  (Maag  and  Bair,  1956). 

In  summary,  motivational  factors  with  demon- 
strated validity  for  the  prediction  of  success  in 
pilot  training  are  aviation/flying  interest,  need 
satisfaction,  and  the  discrepancy  between  aptitude 
and  achievement  levels.  The  latter  two  factors 
seem  to  be  especially  important  for  the  isolation 
of  voluntary  withdrawal  eliminations. 
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3. 4. 1.5  Personality  - The  majority  of  the 
studies  reviewed  in  this  domain  have  focused  upon 
the  usefulness  of  personality  inventories.  These 
data  are  summarized  in  Figure  3.4-5.  Ellis  and 
Conrad  (1948),  in  an  early  review  of  the  literature, 
summarized  the  results  of  personality  research  re- 
lated to  success  in  the  military  (predominantly 
pass-fail  in  training).  Nineteen  studies  were 
cited,  covering  16  different  personality  inventories. 
They  concluded: 

"...only  seldom  did  the  personality  inventor- 
ies prove  distinctly  effective  in  predicting 
or  discriminating  successful  from  unsuccessful 
performance."  (p.  411) 

Studies  reviewed  in  this  report  are  more  recent, 
making  use  of  different  personality  inventories 
from  those  cited  by  Ellis  and  Conrad  (1948).  The 
outlook  for  the  prediction  of  success  in  pilot 
training  is  also  more  positive,  perhaps  due  to 
advancements  in  personality  test  development. 

The  Minnesota  Hultiphasic  Personality  Inventory 
(MMPI)  is  one  inventory  with  demonstrated  validity 
in  most  cases.  This  instrument  contains  ten  clin- 
ical scales,  and  is  the  most  widely  used  personal- 
ity inventory  (Anastasi,  1968).  Fulkerson,  Freud, 
and  Raynor  (1958),  with  a sample  of  pilots  class- 
ified as  well  adjusted  or  poorly  adjusted,  found 
statistically  significant  correlations  with  five 
clinical  scales  (.20  with  Psychopathic  Deviate, 

.18  with  Psychasthenia , .12  with  Hysteria,  .17  with 
Depression,  and  .22  with  Hypochondriasis).'^  Sim- 
ilarly, Melton  (1954),  using  scores  from  the  MMPI, 
was  able  to  cl.  ssify  83%  of  a sample  of  Navy  cadets 
into  pass-fail  categories  correctly. 


'**The  stage  of  training  during  which  this  mea- 
sure is  employed  may  be  critical  to  this  finding, 
since  morale  level  is  reported  to  increase  from 
preflight  to  basic  training  (Rickus  and  Ambler, 
1967). 

'"’Other  self-report  inventories  found  useful 
for  the  prediction  of  psychiatric  classifications 
(e.g.,  psychiatric  casualties)  are  the  Cornell 
Index  (Barry  and  Raynor,  1953)  and  the  Cornell 
Word  Form  (Barry,  Sells,  and  Trites,  1954). 
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There  Is  some  suggestion,  however,  that  the 
MMPI  is  differentially  effective  with  different 
criteria.  Voas,  Bair,  and  Ambler  (1957)  obtained 
significant  differences  on  seven  clinical  scales 
when  cadets  who  failed  during  preflight  training 
were  contrasted  with  the  total  population  of  cadets 
(all  cadets  included).  However,  no  differences 
were  obtained  between  fear  of  flying  eliminees 
in  basic  training  and  the  total  population. 

The  Eysenck  Personality  Inventory  (EPI)  is  a 
second  self-report  inventory  with  demonstrated 
validity  for  the  prediction  of  success  in  training. 
The  EPI  measures  two  personality  dimensions: 

(1)  Extroversion-Introversion;  and  (2)  Neuroticism- 
Stability.  With  a Royal  Air  Force  sample,  Jessup 
and  Jessup  (1971)  found  significant  differences 
using  the  pass-fail  crierion.  A relatively  large 
number  of  failures  occurred  in  the  Neurotic- 
Introvert  quadrant  (60%)  and  relatively  few  in  the 
Stable-Introvert  quadrant  (14%).  Cadets  in  the  two 
Extrovert  quadrants  had  failure  rates  of  32  to  37%. 

Other  personality  dimensions  found  to  be  re- 
lated to  success  in  training  are  ego  identity, 
cautiousness,  and  vigor.  Trexler  (1969)  developed 
an  Ego  Identity  Questionnaire  measuring  three 
personality  aspects:  (1)  knowledge  of  who  you  are; 

(2)  knowledge  of  where  you  are  going;  and  (3)  aware- 
ness of  how  you  are  perceived  by  others.  Criteria 
used  were  the  pass-fail  criterion  and  academic 
grades  in  flight  training.  Significant  differences 
were  obtained  between  pass  and  fail  groups,  with 
lower  ego  identity  scores  among  failures.  Multiple 
correlations  were  .19  with  the  pass-fail  criterion, 
and  .17  to  .23  with  academic  grades.  Willingham 
and  Ambler  (1963)  found  significant  correlations 
between  two  traits  measured  by  the  Gordon  Person- 
ality Inventory  (GPI)  and  delinquency  reports  in 
training.  These  correlations  were  -.19  with  the 
Cautiousness  dimension  and  -.17  with  the  Vigor 
dimension. 

"The  Thousand  Aviator  Study,"  a longitudinal 
study  conducted  by  the  Navy  and  the  U.S.  Public 
Health  Service,  and  later  by  NASA,  provides  data 
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on  the  relationship  between  the  psychological 
characteristics  of  a large  group  of  aviators  and 
their  physical,  physiological  and  life  history 
characteristics  (Oberman,  Lane,  Mitchell,  and  Gray- 
biel,  1965).  This  study  began  in  1940  when  1056 
student  aviators  and  flight  instructors  were  exam- 
ined on  a variety  of  physiological  and  psychological 
parameters.  Follow-up  examinations  were  conducted 
in  1951,  1957,  and  1963-65;  the  latter  being  the  most 
comprehensive  to  data.  In  the  1963-65  study,  675  mem- 
bers of  the  Thousand  Aviator  Group  were  evaluated 
in  Pensacola. 

Ten  of  100  variables  studied  in  "The  Thousand 
Aviator  Study"  were  scales  of  the  Guilford-Zimmerman 
Temperament  Survey  (GZTS),  a 300  question,  self- 
report  personality  questionnaire.  Figure  3.4-6 
summarizes  statistically  significant*®  correlations 
between  90  anthropometric,  physical,  physiological 
and  life  history  variables  and  each  of  the  ten  GZTS 
scales.  While  some  68  of  the  possible  900  correla- 
tions were  significant,  none  was  greater  than  .19. 
Although  it  can  be  argued  that  the  test  population 
was  relatively  homogeneous,  no  compelling  case  can 
be  made  for  high  relatedness  between  temperament 
and  anthropometric,  physical,  or  physiological 
characteristics.*^  While  this  effort  was  quite 
ambitious,  it  has  limited  usefulness  since  the 
question  of  how  these  variables  relate  to  success 
in  military  training  was  not  addressed. 

Other  self-report  inventories  which  have  been 
investigated,  but  which  show  little  promise  as  pre- 
dictors, include  the  California  Psychological  Inven- 
tory (Bucky  and  Ridley,  1972),  the  Pensacola  Z , 
Scale,  the  Adjective  Check  List,  and  Catell's  16 
Personality  Factor  Questionnaire  (Fleishman,  et  al , 
1966). 


*®The  .015  level  of  confidence  was  used  by  the 
authors  to  adjust  for  artifactual  significance 
resulting  from  multiple  comparisons. 

*^Also,  see  Cook  (1961),  Cortes  and  Gatti  (1965), 
and  Cortes  and  Gatti  (1966). 
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There  are  several  self-report  inventories  which 
specifically  measure  differences  in  anxiety.  One 
of  the  more  well-known  is  the  Taylor  Manifest  Anx- 
iety Scale  (TMAS).  Fleischman,  et  aj^t  (1966) 
related  scores  on  this  inventory  as  well  as  on  the 
Alternate  Manifest  Anxiety  Scale  (AMAS)  to  three 
criteria  of  success  in  flight  training.  These  were 
the  pass-fail,  flight  failure  eliminat'ion,  and  vol- 
untary withdrawal  elimination  criteria.  Both  tests 
were  administered  during  the  first  week  of  training 
(preflight).  Scores  on  the  TMAS  correlated  signif- 
icantly with  the  pass-fail  criterion  (r  = -.10)  and 
the  voluntary  withdrawal  elimination  criterion 
(r  = -.16).  AMAS  scores  were  unrelated  to  all  cri- 
teria. 

There  is  some  suggestion,  however,  that  the 
TMAS,  when  administered  early  in  training,  shows 
differential  validity  with  different  criteria. 

Voas,  et  (1957)  obtained  significant  differ- 
ences with  the  TMAS,  administered  during  the  first 
week  of  primary  training,  when  failures  during  pre- 
flight training  were  contrasted  with  the  total 
population  of  cadets  (all  cadets  included).  How- 
ever, no  differences  were  obtained  between  fear  of 
flying  eliminees  in  basic  training  and  the  total 
population.  When  the  TMAS  was  administered  at  the 
time  of  separation  from  training,  significant 
differences  were  found  between  fear  of  flying  elim- 
inees and  two  other  groups  (entering  cadets  and 
cadets  separated  from  the  program  and  not  reporting 
fear).  Therefore,  the  TMAS  showed  concurrent  valid- 
ity, but  not  predictive  validity  for  fear  of  flying 
elimination  in  basic  training.  A similar  pattern 
of  results  was  obtained  with  the  Heineman  Anxiety 
Scale  (HAS).  Significant  differences  were  also 
found  between  these  groups  with  the  Saslow  Screen- 
ing Test,  another  anxiety  test,  when  administered 
at  the  time  of  separation  from  the  program. 

Clinical  assessment  is  a third  class  of  pre- 
dictor within  the  domain  of  personality.  These 
assessments  are  typically  based  upon  clinical  inter- 
views which  sometimes  include  projective  tests. 
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One  clinical  assessment  measure  is  the  Adapt- 
ability Rating  for  Military  Aeronautics  (ARMA),  a 
personality  assessment  made  by  the  flight  surgeon. 
In  an  unselected  sample  of  pilot  trainees^during 
World  War  II,  the  ARMA  showed  a correlation  of 
approximately  .20  with  the  pass-fail  criterion 
(DuBois,  1947).  However,  as  noted  by  Mebane 
(1957),  the  relationship  between  the  ARMA  and  cri- 
teria is  dependent  upon  the  skill  of  the  examiner. 
Culpepper,  Jennings,  and  Perry  (1972)  reported  on 
the  validity  of  psychiatric  rankings  of  suitability 
for  the  prediction  of  class  standing  in  the  United 
States  Air  Force  Research  Pilot  School.  Correla- 
tions showed  a great  deal  of  variability,  ranging 
from  -.19  to  .57  with  different  classes. 

One  of  the  more  popular  projective  techniques 
is  the  Rorschach  Test,  which  consists  of  a series 
of  inkblot  displays.  Responses  to  these  displays 
are  then  assessed  by  clinical  personnel.  Holtzman 
and  Sells  (1954)  found  these  clinical  assessments 
to  be  ineffective  for  the  prediction  of  pass-fail 
in  basic  flight  training. 

With  other  criteria,  these  assessments  have 
been  more  useful.  McMichael  and  Graybiel  (1963) 
related  scores  on  five  Rorschach  composites 
(anxiety,  dependency,  drive,  lability  [instabil- 
ity] of  emotions,  and  rigidity)  to  ranked  scores 
on  susceptibility  to  airsickness  in  four  experi- 
mental situations.  These  situations  consisted  of 
exposure  to  aerial  acrobatics,  going  to  sea  in  a 
power  boat  in  a high  sea  state,  exposure  in  a slow 
rotation  room,  and  experiencing  zero  q.  These 
correlations  ranged  from  -.12  to  .94.  The  highest 
correlations  were  obtained  with  the  lability  and 
rigidity  composites.  Correlations  with  the  total 
composite  were  significant  in  three  of  the  four 
situations  (r  = .47  to  .68).  In  addition.  Tucker 
and  Reinhardt  (1966)  found  significant  relation- 
ships between  two  Rorschach  scores  and  the  type 
of  aircraft  flown.  Scores  were  obtained  for  a 
barrier  dimension  (degree  of  body  boundary  defin- 
iteness) and  penetration  (degree  to  which  body 
boundary  is  perceived  as  permeable).  Jet  pilots 
had  higher  barrier  scores  than  did  propellar  and 
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helicopter  pilots.  This  indicates  a well-defined 
body  image  among  jet  pilots  who  have  few  visual 
cues  for  reference  while  flying.  Secondly,  heli- 
copter pilots  had  lower  penetration  scores  than  did 
propellar  aircraft  pilots,  which  is  interpreted  as 
indicating  lower  anxiety.  However,  since  this 
study  used  pilots  rather  than  pilot  candidates, 
little  can  be  said  with  respect  to  the  value  of 
these  Rorschach  composites  for  selection. 

In  summary,  some  personality  inventories  (MMPI, 
EPI,  Ego  Identity  Questionnaire,  GPI,  TMAS,  HAS) 
seem  to  show  some  promise  for  the  prediction  of 
success  in  pilot  training.  Potential  limitations 
with  respect  to  the  prediction  of  fear  of  flying 
eliminations  have  been  noted  with  several  of  these 
inventories,  especially  those  measuring  anxiety. 

Clinical  assessments  while  related  to  some 
criteria  (susceptibility  to  airsickness),  appear 
to  be  less  useful  with  other  criteria  (e.g.,  the 
pass-fail  criterion). 

3.4. 1.6  Reaction  to  Stress  - As  can  be  seen 
from  Figure  3.4-7,  studies  reviewed  in  this  domain 
are  of  two  basic  types:  (1)  those  using  paper-and- 

pencil  tests; 'and  (2)  those  using  stressful  situa- 
tions. Most  studies  were  predominantly  of  the 
former  type. 

Some  of  the  research  using  paper-and-pencil 
tests  are  studies  of  concurrent  validity  rather 
than  predictive  validity,  making  conclusions  about 
selection  difficult.'®  Clark  and  Graybiel  (1957) 
studied  the  relationship  between  reactions  to  high 
altitude  flights  reported  in  an  interview  and  the 
number  of  vertigo  (confusion  with  regard  to  posi- 
tion in  space)  experiences  reported  in  a Checklist 
of  Flight  Experiences.  More  vertigo  experiences 
were  found  in  pilots  reporting  increased  excitement, 
fear,  anxiety,  and  increased  alertness.  However, 
these  data  are  difficult  to  interpret.  These 
differences  could  result  from  prior  differences  in 
the  ability  to  handle  stress.  Alternatively,  they 
could  be  the  product  of  differences  in  vertigo 
experiences. 
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This  type  of  problem  is  present  in  two  addi- 
tional studies.  Roberts  and  Wicke  (1972)  found 
differences  in  self-testing  attitudes  among  fighter, 
attack,  helicopter,  and  patrol  aircraft  pilots. 
Fighter  pilots  had  higher  self-testing  attitudes 
than  did  all  other  types  of  pilots.  Finally, 

Aitken  (1972)  investigated  the  reactions  of  normal 
and  aerophobic  pilots  to  several  types  of  situations 
in  a self-report  inventory.  Aerophobic  pilots 
reported  that  they  could  spend  less  time  seated  in 
four  situations  (normal  sortie,  standby,  reading, 
and  in  the  cinema).  As  with  the  prior  study,  no 
conclusion  can  be  drawn  with  regard  to  the  value 
of  these  measures  for  selection. 

Studies  using  paper-and-pencil  tests  which 
permit  interpretation  have  focused  upon  anxiety 
and  stress  tolerance  measures.  The  State-Trait 
Anxiety  inventory  is  one  Instrument  which  has  been 
assessed  (Bucky,  Spielberger,  and  Bale,  1970; 
Holzapfel,  1973).  Bucky,  et  a^,  (1970)  found 
greater  levels  of  state  anxiety  (transitory 
anxiety)  and  lower  levels  of  trait  anxiety  (anxiety 
proness)  in  aviation  officer  candidates  than  in 
college  students.  However,  other  data  question 
the  value  of  these  measures  for  the  prediction  of 
success  in  flight  training.  Holzapfel  (1973) 
obtained  negative  correlations  with  the  criterion 
of  flight  grades,  but  none  of  these  values  reached 
significance. 

The  Defense  Mechanism  Test  (DMT),  a measure 
of  stress  tolerance,  has  demonstrated  validity  as 
a secondary  selection  tool  with  Swedish  pilot  can- 
didates (Neuman,  1968;  Neuman,  1972).  Correlations 
with  the  pass-fail  criterion  in  basic  training 
were  .35  with  an  initial  sample  and  .46  with  a 
cross-validation  sample.  Both  values  were  signifi- 
cant at  the  .01  level  of  confidence. 


’®Tests  are  administered  to  pilot  populations 
rather  than  to  pilot  candidates.  Although  tests 
may  discriminate  between  pilot  populations,  there 
is  no  assurance  that  these  same  tests  will  be  sensi- 
tive to  differences  between  pilot  candidates. 
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Encouraging  findings  were  reported  in  studies 
using  stress  tests  as  predictors.  One  such  test  is 
the  Brief  Vestibular  Disorientation  Test,  in  which 
reactions  to  a rotating  chair  are  assessed  (Ambler 
and  Guedry,  1965;  Ambler  and  Guedry,  1968).  Mea- 
sures consisted  of  overall  ratings  by  observers 
after  rotation  had  stopped.  These  ratings  were 
based  upon  factors  such  as  pallor,  sweating,  facial 
expression,  and  unsteadiness.  In  one  study,  corre- 
lations were  .14  with  the  pass-fail  criterion,  .23 
with  the  tension  elimination  criterion,  .18  with 
the  airsickness  elimination  criterion,  and  .23 
with  the  tension  or  airsickness  elimination  cri- 
terion (Ambler  and  Guedry,  1968).  All  correlations 
were  significant  at  the  .05  level  of  confidence  or 
better.  Similar  relationships  were  reported  in  an 
earlier  study  (Ambler  and  Guedry,  1965). 

Voas,  Bair,  and  Ambler  (1956)  assessed  the 
validity  of  reactions  in  a decompression  chamber. 
Measures  were  replacement  of  the  oxygen  mask  before 
the  end  of  a ten  minute  test  period  and  reports  of 
ear  block.  These  responses  were  interpreted  as 
indicative  of  anxiety.  Significant  differences 
were  found  between  fear  of  flying  eliminees  and 
successful  candidates  in  basic  training,  with 
greater  anxiety  in  the  former  group. 

In  summary,  with  the  exception  of  the  DMT,  a^ 
foreign  selection  instrument,  evidence  for  the  ' 
validity  of  paper-and-penci 1 tests  in  this  domain 
is  lacking.  In  contrast,  performance  measures  in 
realistic,  stressful  situations,  such  as  exposure 
to  rotation  and  decompression,  appear  to  be  valid 
predictors  of  success  in  pilot  training.''* 

3. 4. 1.7  Social  - Peer  and  instructor  ratings 
constitute  a valuable  set  of  predictors  for  success 
in  training.  With  a few  exceptions,  relationships 
found  with  these  ratings  were  relatively  substantial 
(see  Figure  3.4-8). 

Studies  on  peer  ratings  differ  with  respect  to 
the  specificity  of  the  rating  used,  i.e.,  overall 
ratings  versus  individual  ratings  on  specific 
traits.  Overall  ratings  were  employed  in  two 
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studies  reviewed.  Fleischman,  e_t  al , (1966)  found 
significant  correlations  between  preflight  peer 
ratings  and  two  of  three  criteria  investigated 
(r  = .17  with  the  pass-fail  criterion,  r = .23 
with  the  flight  failure  elimination  criterion). 

The  voluntary  withdrawal  elimination  criterion 
was  not  predictable  from  this  rating  (r  = .06). 

A second  prediction  failure  was  reported  by  Tupes, 
^ a^,  (1966).  No  relationship  was  found  between 
peer  ratings  from  the  ROTC  Evaluation  Scale  and 
motivation  for  flying  training. 

Other  studies  have  focused  upon  the  validity 
of  more  specific  types  of  peer  ratings.  There  is 
little  overlap  with  respect  to  the  types  of  ratings 
investigated  in  this  research.  Suci  and  Valance 
(1954)  related  three  types  of  ratings  (Promise  as 
an  Officer,  Outstandingness  as  an  Officer,  and 
Aptitude)  to  military  and  academic  grades  in  Naval 
Officer  Candidate  School.  All  three  ratings  proved 
useful.  Ratings  on  Promise  as  an  Officer  showed 
correlations  of  .33  to  .73  with  military  grades 
and  .24  to  .34  with  academic  grades.  Similar 
results  were  reported  with  the  other  two  types  of 
ratings. 

Willingham  (1958)  studied  the  relationship 
between  peer  ratings  on  17  personal  traits^®  and 
three  criteria:  (1)  Flight  failure  elimination; 

(2)  Voluntary  withdrawal  elimination;  and 

(3)  Number  of  months  required  to  complete  flight 
training.  The  ranges  of  these  correlations  are 


’‘'Studies  also  indicate  that  physiological  mea- 
sures in  stressful  situations  have  potential  value 
for  selection  in  training  (Mefferd,  Hale,  Shannon, 
Prigmore,  and  Ellis,  1971;  O'Connor,  1973). 

‘’’Several  studies  have  addressed  the  question 
of  the  factor  structure  of  peer  ratings  on  personal 
traits.  With  different  samples  of  basic  airmen, 
Elliott  (1960)  and  Ewart  (1960)  found  four  inter- 
pretable factors.  These  were:  (1)  General  Factor 

(overall  acceptance  or  rejection  factor),  (2)  Good 
Naturedness,  (3)  Sociability,  and  (4)  Motivation 
for  Military  Life.  Tupes  and  Kaplan  (1961a)  ob- 
tained five  factors  with  a sample  of  Air  Force 
Officers:  (1)  Surgency  (quickness  and  clever- 

ness), (2)  Aqreeableness,  (3)  Determination, 

(4)  Adjustment,  and  (5)  Social  Intelligence. 
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shown  in  Figure  3.4-8.  The  Leadership  Rating  was 
the  best  predictor  of  the  flight  failure  elimination 
criterion  (r  = .27  to  .29)  and  number  of  months  to 
complete  flight  training  (r  = .18).  The  voluntary 
withdrawal  elimination  criterion  was  predicted 
equally  well  by  the  Leadership  Rating  (r  = .20  to 
.21)  and  the  rating  for  the  question:  ".  . . this 

person  would  never  consider  DORing"^*  (p.  5) 

(r  = .27  to  .28).  Finally,  Peterson,  Lane,  and 
Ambler  (1966)  found  significant  correlations  be- 
tween carefulness  peer  ratings  and  two  criteria 
(preflight  grades  and  the  pass-fail  criterion). 

Comparable  results  have  been  obtained  with 
instructor  ratings.  The  Instructor  Prediction 
Form  is  one  questionnaire  that  has  been  used 
(Martoccia  and  Nelson,  1956).  In  this  question- 
naire, instructors  are  asked  their  opinion  regard- 
ing each  candidate's  probability  of  completing  a 
specific  flight  phase.  Correlations  with  the  pass- 
fail  criterion  in  basic  training  ranged  from  .26  to 
.36.  Waag  and  Shannon  (1972)  investigated  the 
relationship  between  four  instructor  ratings 
(Probability  of  Getting  Wings,  Motivation,  Headwork, 
and  Reaction  to  Stress)  and  the  pass-fail  criterion 
in  flight  training.  These  correlations  ranged 
from  .20  to  .28.  Similar  findings  were  reported 
by  Waag,  Shannon,  and  Ambler  (1973)  with  two  samples 
(Aviation  Officer  Candidates,  and  Officers  under 
Instruction) . 

In  conclusion,  both  peer  ratings  and  instruc- 
tor ratings  seem  to  be  valid  predictors  of  success 
in  pilot  training. 

3.4.2  Critical  Skills  - Included  in  this  cate- 
gory are  factors  related  to  aviator  skills,  know- 
ledges, and  tasks;  information  processing  rate; 
job  sample  performance;  light  plane  performance; 
sensory-motor  skills;  and  behavior  in  situational 
tests.  Relationships  between  these  predictors  and 
the  criteria  noted  earlier  (Section  3.4)  are  re- 
viewed in  Sections  3.4.2. 1 through  3.4. 2. 6. 

3. 4. 2.1  Aviator  Skills,  Knowledges,  and 
Tasks  - As  shown  in  Figure  3.4-9,  predictors  within 


this  domain  are  paper-and-pencil  measures  as  well 
as  flight  performance  measures. 

Many  of  the  paper-and-pencil  tests  are  compo- 
nents of  larger  classification  or  aptitude  batter- 
ies. Two  such  batteries  are  the  Army  Air  Force's 
Qualifying  Examination  (AAFQE)  and  the  Aircrew 
Classification  Battery  (ACB),  which  were  in  use 
during  World  War  II  (DuBois,  1947;  Flanagan,  1948; 
Miller,  1947).  The  AAFQE  contained  a Flying  Infor- 
mation Test.  This  test  showed  a correlation  of  .34 
with  the  pass-fail  criterion  with  an  unselected 
sample  of  candidates  for  pilot  training  during 
World  War  II  (DuBois,  1947).  Three  subtests  of  the 
ACB  showed  similarly  high  correlations  with  this 
sample  (r  = .40  for  Dial  and  Table  Reading, 
r = .37  for  Instrument  Comprehension  I,  r = .46 
for  Instrument  Comprehension  II). 

The  Air  Force  Officer  Qualifying  Test  (AFOQT) 
includes  five  subtests  which  fall  within  this 
domain.  These  are  Table  Reading,  Aerial  Landmarks, 
Instrument  Comprehension,  Aerial  Orientation,  and 
Visual fzatfort  of  Maneuvers  (Valentine,  1961). 
Correlations  between  these  subtests  and  the  pass- 
fail  criterion  in  primary  and  basic  training  ranged 
from  -.02  to  .45.  With  the  flight  failure  elimina- 
tion criterion,  these  correlations  ranged  from  .11 
to  .46.  Generally,  correlations  were  higher  with 
the  latter  criterion  than  with  the  former.  Sub- 
tests with  the  highest  validity  coefficients  were 
Instrument  Comprehension,  Aerial  Orientation,  and 
Visualization  of  Maneuvers.  With  other  criteria  in 
basic  training,  relationships  were  lower  (r  = .04 
to  .19  with  academic  grades,  r = -.06  to  .00  with 
fl ight  grades) . 

Included  in  the  Army  Fixed  Wing  Aptitude 
Battery  (AFWAB)  are  tests  for  Aeronautical  Informa- 
tion, Aircraft  Orientation,  and  Flight  Visualization 
(Kaplan,  1965).  Correlations  between  these  subtests 
and  the  pass-fail  criterion  in  flight  training 
ranged  from  .20  to  .34.  With  the  flight-failure 


^'DORing  refers  to  dropping  on  request. 
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elimination  criterion,  these  correlations  ranged 
from  .18  to  .46.  The  Aeronautical  Information 
Test  yielded  the  highest  validity  coefficients  with 
both  criteria. 

Tests  with  little  predictive  validity  were  the 
Aerial  Orientation  Test,  a subtest  of  the  Aviation 
Cadet-Officer  Candidate  Qualifying  Exam  (Tupes, 
e^  al^,  1955),  and  the  Aviation  Information  Test 
(Greene,  1947;  Lane,  1947). 

As  might  be  expected,  flight  grades  have  shown 
fairly  strong  relationships  with  success  in  train- 
ing (Cooper,  et  aj^,  1976;  Flyer  and  Bigbee,  1955b; 
Martoccia  and  Nelson,  1956).  For  example.  Cooper, 
et  al^,  (1976)  obtained  a correlation  of  .42  between 
undergraduate  pilot  training  flight  grades  and 
flight  grades  in  the  Replacement  Training  Unit. 
Similarly,  Flyer,  and  Bigbee  (1955b),  reporting  on 
the  validity  of  three  primary  flight  grades,  found 
correlations  ranging  from  .11  to  .37  with  the  pass- 
fail  criterion  and  from  .33  to  .60  with  the  flight- 
failure  elimination  criterion  in  basic  training. 

Five  of  six  correlations  were  significant  at  the 
.01  level  of  confidence. 

In  summary,  several  aptitude/classification 
batteries  contain  subtests  which  seem  to  be  useful 
in  predicting  success  in  pilot  training.  These 
include  the  Flying  Information  subtest  of  the  AAFQE; 
Dial  and  Table  Reading  and  Instrument  Comprehension 
Subtests  of  the  ACB;  Instrument  Comprehension, 

Aerial  Orientation,  and  Visualization  of  Maneuvers 
subtests  of  the  AFOQT;  and  the  Aeronautical 
Information  subtest  of  the  AFWAB.  As  anticipated, 
flight  grades  also  show  strong  relationships  with 
criteria  of  success  in  training. 

3. 4. 2. 2 Information  Processing  Rate  - In 
contrast  to  many  other  domains,  interest  in  infor-  . 
mation  processing  rate  as  related  to  success  in 
pilot  training  is  relatively  recent.  Available 
data  summarized  in  Figure  3.4-10  suggest  that  this 
area  warrants  continued  attention. 

In  commenting  upon  the  psychological  qualities 
which  .ire  essential  to  aviators,  Lin  (1969)  listed 
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the  following:  (1)  ability  to  judge  perceptions 

quickly  and  accurately;  (2)  ability  to  distribute 
and  shift  attention;  (3)  alertness  of  response; 

(4)  good  simulation  ability  and  memory;  (5)  coor- 
dination of  hand  and  foot  movements;  and  (6)  stable 
emotions  and  strong  will.  Most  of  these  qualities 
are  in  the  realm  of  information  processing  rate. 


Interest  in  this  domain  was  also  expressed  by  >1 

Pew  and  Adams  (1975).  They  proposed  an  information  jj 

processing  battery  which  contains  tests  in  the  | 

following  areas:  (1)  active  memory  capacity;  Ji 

(2)  spatial  orientation  and  processing  of  spatially  d 

disparate  sources  of  information;  (3)  manageability  | 

of  attention;  (4)  linguistic  decoding;  (5)  percep-  ji 

tual -motor  coordination;  and  (6)  multiple  task  jl 

management  and  workload  capacity.  This  battery  ^ 

is  presently  being  validated  using  two  measures  I 

(pilot  ratings  and  scores  on  a simulator)  collected  | 

1 

during  the  T-37  phase  of  pilot  training.  ) 

Two  types  of  tasks  were  employed  in  valida-  | 

tion  studies  reviewed:  (1)  divided  attention;  and 

(2)  selective  attention.  Both  types  of  tasks 
proved  useful  in  selection  for  pilot  training. 

In  divided  attention  tasks,  two  tasks  are  per-  I 

formed  concurrently,  and  measures  of  residual  I 

attention  are  monitored.  Residual  attention  refers 
to  the  amount  of  attention  left  over  while  perform-  I 

ing  Task  1 (Primary  Task),  within  certain  predefined  ' 

limits,  for  the  performance  of  Task  2 (Secondary 
Task).  With  a sample  of  candidates  enrolled  in  a I 

Private  Pilot  Course,  Damos  (1972)  found  substan-  ) 

tial  correlations  between  Secondary  Task  Perfor-  f 

mance  and  flight  check  grades  in  training.  The  I 

Primary  Task  was  a compensatory  tracking  task, 
while  the  Secondary  Task  was  an  information  pro- 
cessing task.  Groups  were  tested  before  flight 
training  or  after  25  hours  of  flight  training, 
with  checkrides  conducted  after  10,  20,  and  30 
hours  of  flight  training.  Correlations  between  me- 
dian response  time  on  the  Secondary  Task  and  flight 
check  grades  ranged  from  .17  to  .69.  Approximately  • 

half  of  these  correlations  were  above  .50.  Simi-  J 

larly,  Trankell  (In  North  and  Gopher,  1976)  \ 

reported  a correlation  of  .42  between  scores  on  a j 
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divided  attention  task  (rhythmic  tapping  while 
solving  a complex  problem)  and  success  in  airline 
pilot  training. 

North  and  Gopher  (1976)  used  a somewhat  dif- 
ferent paradigm  for  divided  attention.  Performance 
on  two  tasks  (compensatory  tracking  and  digit  pro- 
cessing tasks)  was  to  be  kept  within  specified 
limits.  Initially,  these  tasks  were  performed 
singly,  after  which  they  were  performed  concurrent- 
ly. Comparisons  were  made  between  students  and 
instructors  using  measures  on  both  tasks.  The 
most  meaningful  type  of  measure  was  the  proportion 
score,  defined  as  the  proportional  amount  of  per- 
formance in  the  single  task  retained  during  the 
dual  task  or  timesharing  situation.  No  differences 
in  proportion  scores  were  found  with  the  digit- 
processing task.  However,  instructors  had  signif- 
icantly higher  proportion  scores  in  the  compensa- 
tory tracking  task,  indicating  greater  timesharing 
ability  among  instructors. 

Selective  attention  tasks  require  screening  or 
attending  to  relevant  information  embedded  within 
the  context  of  irrelevant  information.  One  type  of 
selective  attention  task  is  dichotic  listening,  in 
which  candidates  are  instructed  to  attend  to  mes- 
sages presented  to  one  ear  (relevant  ear)  while 
messages  are  also  presented  to  the  second  ear 
(irrelevant  ear).  With  an  Israeli  Air  Force 
sample.  Gopher  and  Kahneman  (1971)  found  correla- 
tions ranging  from  .10  to  .36  when  selective  atten- 
tion errors  were  correlated  with  the  pass-fail 
criterion  (candidates  were  tracked  through  advanced 
training).  Two  of  three  correlations  were  signif- 
icant at  the  .01  level  of  confidence.  Similar 
relationships  were  obtained  between  these  measures 
and  type  of  pilot  assignment  (r  = .08  to  .32). 

In  conclusion,  these  data  suggest  that  infor- 
mation processing  measures  in  tasks  such  as  divided 
attention  and  selective  attention  are  valid  predic- 
tors of  success  in  pilot  training. 

3.4. 2. 3 Job  Sample  - In  the  job  sample  ap- 
proach, predictors  consist  of  work  samples  on 
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trainers  which  are  gathered  early  in  training.  It 
is  superior  to  ability  testing  in  that  it  allows 
for  the  complex  interactions  of  abilities  (Goebel, 
Baum,  and  Hagin,  1971;  Passey  and  McLaurin,  1966). 

As  can  be  seen  from  Figure  3.4-11,  this  approach 
appears  to  be  valuable  for  the  prediction  of  flying 
proficiency. 

Goebel,  et  £[,  (1971)  related  instructor  eval- 
uations based  upon  maneuvers  in  a General  Aviation 
Trainer  (GAT-1)  to  flight  grades  at  two  stages 
(T-41  and  T-37)  of  training.  Correlations  with 
flight  grades  at  the  T-41  phase  ranged  from  .44  to 
.56.  All  values  were  significant  at  the  .01  level 
of  confidence.  Correlations  with  flight  grades  at 
the  T-37  phase  were  substantially  lower  (r  = .07  to 
.45),  and  only  1 of  12  values  reached  significance. 
Poorer  prediction  at  this  latter  stage  could  be  due 
to  a restriction  of  range  produced  by  the  inter- 
vening T-41  phase  of  training. 

LeMaster  and  Gray  (1974)  studied  the  relation- 
ship between  work  samples  on  the  T-40  Instrument 
Trainer  and  two  criteria  (T-37  flight  grades  and 
the  pass-fail  criterion  in  training).  Three  cate- 
gories of  predictors  were  used.  There  were  15 
maneuver  measures,  6 systems  management  measures, 
and  9 flying  procedure  measures.  Scores  for  maneu- 
vers consisted  of  deviations  from  0 (perfection)  on 
flight  parameters  such  as  airspeed,  bank,  heading, 
and  roll  rate.  Measures  of  system  management  were 
response  times  to  complete  lightbox  problems  pre- 
sented while  flying  the  trainer.  Flying  procedure 
measures  consisted  of  percentage  correct  for  activ- 
ities such  as  power  setting,  takeoff  procedures, 
turns  to  assigned  headings,  and  radio  communications. 

Correlations  between  maneuver  measures  (devia- 
tions from  perfection)  and  T-37  flight  grades 
(checkrides,  instrument  check,  and  phase, grade) 
ranged  from  -.61  to  -.02  (35  of  45  values  were 
statistically  significant  at  the  .05  level  of 


^^Restriction  of  range  produces  a depression  in 
the  correlation  coefficient  (McNemar,  1969). 
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FIGURE  3.4-12  STATISTICAL  RESULTS  OF  FIXED  RING  PILOT  SELECTION  STUDIES  RELATING  MEASURES  OF  PERFORMANCE  ON  LIGHT  PLANES  TO  CRITERIA  OF  SUCCESS  IN  TRAINING 
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confidence  or  better).  Correlations  between  system 
management  measures  (latency)  and  flight  grades 
ranged  from  -.35  to  .01  (7  of  18  values  were  statis- 
tically significant).  Correlations  between  flying 
procedure  measures  (percentage  correct)  and  flight 
grades  ranged  friwt  -.10  to  .41  (8  of  27  values  were 
statistically  significant).  Therefore,  maneuver 
measures  provided  the  highest  validities. 

In  contrast,  correlations  with  the  pass-fail 
criterion  were  substantially  lower.  These  corre- 
lations ranged  from  -.24  to  .06  with  maneuver 
measures  (9  of  15  values  reached  significance), 
from  -.13  to  -.02  with  systems  management  measures 
(of  6 values,  0 were  significant),  and  from  -.02  to 
.19  with  flying  procedure  measures  (3  of  9 values 
reached  significance). 

Finally,  Poe  and  Lyon  (1952)  addressed  the 
question  of  whether  or  not  instruction  in  the 
Cycloramic  Link  Trainer  increased  the  probability 
of  success  in  primary  training.  No  differences 
were  obtained  between  candidates  given  this  instruc- 
tion and  a control  group  using  two  criteria: 

(1)  flight  failure  elimination;  and  (2)  the  number 
of  board  meetings  for  flight  difficulties. 

In  summary,  fairly  high  correlations  have  been 
found  between  work  samples  on  trainers  and  flight 
grades  in  pilot  training.  However,  reported  cor- 
relations are  substantially  lower  with  the  pass- 
fail  criterion.  This  latter  result  may  be  attribu- 
table to  the  failure  to  identify  attritions  due  to 
factors  unrelated  to  flying  proficiency  (LeMaster 
and  Gray,  1974). ^3  There  is  also  some  suggestion 
that  experience  on  trainers  does  not  increase  the 
probability  of  ultimate  success  in  training. 

3. 4. 2. 4 Light  Plane  - Both  the  Navy  and  Air 
Force  have  established  Flight  Indoctrination 
Programs  (FIP)  consisting  of  instruction  in  light 
planes.  As  shown  in  Figure  3.4-12,  FIP  performance 
measures  have  proved  valuable  in  predicting  several 
criteria  of  success  in  pilot  training. 

With  a Navy  sample,  Berkshire  and  Ambler  (1963) 
assessed  the  validity  of  FIP  instructor  ratings  and 
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flight  grades  using  a variety  of  criteria.  Instruc- 
tor ratings  had  correlations  of  .23  with  academic 
(preflight)  grades,  .49  with  primary  flight  grade, 
.37  with  final  overall  grade,  .36  with  the  pass- 
fail  criterion,  .28  with  the  flight  failure  elim- 
ination criterion,  .14  with  the  ground  failure 
elimination  criterion,  and  .30  with  the  voluntary 
withdrawal  elimination  criterion.  FIP  flight 
grades  yielded  comparable  values  (see  Figure 
3.4-12).  Similarly,  in  a comparison  of  FIP  and 
non-FIP  students,  FIP  students  had  superior  grades 
throughout  flight  training  and  had  attrition  rates 
which  were  approximately  1/2  that  of  non-FIP  stu- 
dents (Ambler  and  Waters,  1967).^“* 

Air  Force  FIP  results  are  equally  impressive. 
The  attrition  rate  in  undergraduate  pilot  training 
within  the  Air  Force  is  approximately  27.3%,  with 
13.5%  of  these  occurring  in  the  T-41  (light  plane) 
phase.  Among  FIP  students,  the  overall  attrition 
rate  is  approximately  20%,  with  4 to  6%  in  the 
T-41  phase.  In  contrast,  non-FIP  students  have 
an  overall  attrition  rate  of  approximately  34% 
and  a T-41  rate  of  18%  (Heard,  1970). 

In  three  studies.  Flyer  and  Bigbee  (1954, 

1955a,  1955b)  found  substantial  correlations  be- 
tween light  plane  grades  and  pass-fail  type  cri- 
teria in  primary  and  basic  training.  For  example. 
Flyer  and  Bigbee  (1955a)  found  correlations  rang- 
ing from  .29  to  .48  with  the  pass-fail  criterion 
(see  Figure  3.4-12).  All  values  were  significant 
at  the  .05  level  of  confidence  or  better.  In  a 
second  study,  correlations  were  .41  with  the  pass- 
fail  criterion  and  .54  with  the  flight  failure 


^"*Long  and  Varney  (1975)  related  job  sample  per- 
formance to  pass-fail  and  flight  grade  criteria 
using  multivariate  techniques.  This  study  is  dis- 
cussed in  Section  3.4.3. 

^‘*For  additional  Navy  studies,  see  Ambler  (1964) 
and  Ambler  and  Berkshire  0960). 

^^There  is  some  suggestion  that  differences  in 
T-41  performance  have  implications  for  success  in 
later  stages  of  training.  Goebel,  et  al , (1971) 
studied  the  relationship  between  T-4T  FTight  grades 
and  T-37  flight  grades.  Correlations  ranged  from 
-.10  to  .52.  Five  of  twelve  correlations  were 
significant  at  the  .05  level  of  confidence  or 
better. 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


elimination  criterion  in  basic  training.  Both  of 
these  values  were  significant  at  the  .01  level  of 
confidence. 

Using  several  pass-fail  criteria  and  three 
stages  of  training  (preflight,  primary,  and  basic 
training),  Mullins  and  Cox  (1960)  reported  compar- 
able results.  In  four  of  seven  comparisons,  elim- 
inations were  greater  among  non-FIP  than  FIP  stu- 
dents (see  Figure  3.4-12).  Similar  'indings  were 
reported  in  a second  study  (Cox  and  Mullins,  1959).^® 

In  conclusion,  measures  of  performance  on 
light  planes  have  demonstrated  validity  for  the 
prediction  of  several  criteria  of  success  in  pilot 
training. 

3.4. 2. 5 Sensory-Motor  - During  World  War  II, 
sensory-motor  tests  made  significant  contributions 
to  the  prediction  of  success  in  pilot  training. 
However,  due  to  technical  problems,  their  popularity 
declined  shortly  thereafter.  Recently,  there  has 
been  renewed  interest  in  this  important  domain. 

Data  for  this  domain  are  summarized  in  Figure  3.4-13. 

The  relevance  of  sensory-motor  tests  to  pilot- 
ing proficiency  is  clearly  illustrated  by  a factor 
analytic  study  of  flight  maneuvers.  Fleischman  and 
Ornstein  (1960)  factor  analyzed  24  contact  flying 
maneuver  scores  in  the  T-6  aircraft.  Six  factors 
were  identified;  (1)  Control  Precision  (highly 
controlled  muscular  movements);  (2)  Spatial  Orien- 
tation (judgment  of  position  in  three-dimensional 
space);  (3)  Multil imb  Coordination  (coordinated 
use  of  arms  and  legs);  (4)  Response  Orientation 
(ability  to  make  rapid  decisions  under  changing 
stimulus  conditions);  (5)  Rate  Control  (ability  to 
make  responses  in  anticipation  of  velocity  and  rate 
changes);  and  (6)  Kinesthetic  Discrimination 
(involved  in  maneuvers  emphasizing  stalls  and  slow 
movements  of  the  aircraft).  The  first  five  factors 
were  also  found  in  a factor  analytic  study  of  23 
tests  which  included  16  apparatus  tests  developed 
during  World  War  II  (Fleischman  and  Hempel , 1956). 

All  of  these  had  factor  loadings  on  the  apparatus 
tests. 


As. noted  earlier,  sensory-mctor  tests  were 
used  during  World  War  II  for  pilot  selection.  The 
Army  Air  Force's  Qualifying  Examination  contained 
circuits,  hidden  figures,  line  length,  point  dis- 
tance, and  judgment  subtests.  With  an  unselected 
sample  of  candidates  for  pilot  training  during 
World  War  II,  these  tests  showed  correlations 
ranging  from  .16  to  .32  with  the  pass-fail  criter- 
ion (DuBois,  1947;  Flanagan,  1948).  Tests  produc- 
ing the  highest  correlations  were  Judgment  (r  = .32) 
and  Hidden  Figures  (r  * .31). 

The  Aircrew  Classification  Battery  (ACB)  also 
contained  a large  number  of  sensory-motor  tests. 
These  included  tests  for  rotary  pursuit,  rudder 
control,  finger  dexterity,  discrimination  reaction 
time,  two-hand  coordination,  ^nd  complex  coordina- 
tion. With  an  unselected  sample  of  candidates  for 
pilot  training  during  World  War  II,  correlations 
with  the  pass-fail  criterion  ranged  from  .18  to  .42 
(DuBois,  1947;  Flanagan,  1948).  Tests  producing 
the  highest  correlations  were  Complex  Coordination 
(r  = .42),  Discrimination  Reaction  Time  (r  * .41), 
Rudder  Control  (r  » .36),  and  Two-Hand  Coordination 
(r  = .35). 

Highly  similar  findings  are  reported  in  subse- 
quent studies  employing  these  sensory-motor  tests. 
Leiman  and  Friedman  (1952)  (using  the  pass-fail 
criterion  in  advanced  training),  and  Zaccaria  and 
Cox  (1952)  (using  the  pass-fail  criterion  in  pri- 
mary training)  also  found  highest  correlations 
with  the  Rudder  Control,  Complex  Coordination,  and 
Two-Hand  Coordination  tests.  This  finding  is  also 
reported  in  studies  using  the  flight  failure 


26for  additional  Air  Force  studies,  see  Boyle 
and  Hagin  (1953);  and  Sutter,  Townsend,  and  Ornstein 
(1954). 

^’^Roff  (1953)  factor  analyzed  a large  number  of 
psychomotor  tests  and  identified  the  following  six 
factors:  (1)  Integrated  Coordination,  (2)  Visuo- 

Motor  Discrimination,  (3)  Anticipatory  Balancing 
Reaction,  (4)  Eccentric  Pursuit,  (5)  Visuo-Motor 
Discrimination:  Errors,  and  (6)  Pursuit  Learning. 
These  factors  also  show  some  similarity  to  those 
found  by  Fleischman  and  Ornstein  (1960). 
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elimination  criterion  (Creager,  1957;  Payne,  Rohles, 
and  Cobb,  1952)  (see  Figure  3. 4-13). ^8 

Several  studies  stress  the  importance  of 
spatial  factors  for  aircrew  selection  (Ambler  and 
Smith,  1974;  Anderson,  Fruchter,  Manuel,  and  Wor- 
chel , 1954;  Roff,  1951;  Taylor  and  Parker,  1959). 

The  ACB  contained  Spatial  Orientation  I and  Spatial 
Orientation  II  tests.  With  an  unselected  sample 
of  candidates  for  pilot  training  during  World  War 
II,  both  tests  proved  to  be  valuable.  Correlations 
with  the  pass-fail  criterion  were  .34  (Spatial 
Orientation  1)  and  .38  (Spatial  Orientation  II) 
(DuBois,  1947;  Flanagan,  1948).  However,  with 
other  spatial  tests,  such  as  the  Spatial  Orientation 
I test  of  the  Air  Force  Officer  Qualifying  Test 
(Valentine,  1961)  and  the  Spatial  Apperception  Test 
(Bale  and  Ambler,  1971;  Fleischman,  et  al^,  1966), 
relationships  with  several  criteria  of  success  in 
training  are  poor  (see  Figure  3.4-13). 

Overall,  these  sensory-motor  tests  which  were 
popular  during  World  War  II  and  for  a short  time 
afterward  were  found  to  be  valid  for  the  prediction 
of  success  in  pilot  training  and,  in  fact,  they 
were  more  valid  than  paper-and-pencil  tests  in  use 
at  that  time.  The  reason  for  their  discontinuation 
is  explained  by  McGrevy  and  Valentine  (1974): 

"Use  of  psychomotor  assessments  in  the  Air 
Force  pilot  selection  program  were  discon- 
tinued in  the  early  1950s  because  of  the 
expense  and  difficulty  of  maintaining  and 
calibrating  the  required  equipment  under 
decentralized  testing  conditions."  (p.  5) 

Fortunately,  technological  advancements  have 
stimulated  renewed  interest  in  sensory-motor  tests 
as  selection  devices.  Under  Air  Force  sponsorship, 
Passey  and  McLaurin  (1966),  after  an  extensive 
review  of  the  perceptual -psychomotor  literature, 
produced  an  extensive  list  of  "critical  behavior 
functions"  for  aircrew  performance.  These  func- 
tions included  factors  such  as  motor  skill  acquisi- 
tion rate,  perceptual  speed,  kinesthetic  discrimin- 
ation, performance  consistency,  and  psychomotor 
ability. 


In  1970,  the  Air  Force  established  a research 
facility  at  Lackland  Air  Force  Base  for  the  devel- 
opment of  psychomotor  selection  devices.  The  first 
tests  developed  were  modeled  after  two  psychomotor 
tests  which  were  part  of  the  ACB  and  showed  good 
validity  in  World  War  II.  These  are  Complex  Coor- 
dination and  Two-Hand  Coordination  (McGrevy  and 
Valentine,  1974;  Sanders,  Valentine,  and  McGrevy, 
1971).  Scores  on  these  tests  were  validated  against 
several  pass-fail  type  criteria  using  multiple  re- 
gression (McGrevy  and  Valentine,  1974).  Scores  for 
two-hand  coordination  had  multiple  correlations  of 
.18  with  the  pass-fail  criterion  and  .20  with  the 
flight  failure  elimination  criterion.  Neither  of 
these  values  reached  significance.  Scores  for 
complex  coordination  had  multiple  correlations 
ranging  from  .43  to  .60  with  the  pass-fail  crite- 
rion (3  of  6 values  were  statistically  significant), 
.32  to  .50  with  the  flight  failure  elimination 
criterion  (of  6 values,  0 were  statistically 
significant),  and  .43  to  .55  with  the  voluntary 
withdrawal  elimination  criterion  (2  of  5 values 
were  statistically  significant).  Although  many  of 
these  correlations  failed  to  be  statistically  sig- 
nificant, those  for  complex  coordination  are  rel- 
atively large  considering  the  problem  of  a highly 

restricted  range. ^8 

In  summary,  sensory-motor  tests  were  found  to 
be  valid  for  the  prediction  of  success  in  pilot 
training  during  World  War  II.  These  tests  appear 
to  merit  the  renewed  attention  they  are  presently 
being  given. 


^^other  psychomotor  tests  assessed  are  the  Six 
Target  Rudder  Control  and  Dynamic  Balance  Tests 
(Fleischman,  1953),  and  the  Direction  Control  and 
Compensatory  Balance  Tests  (Fleischman,  1954). 
Scores  for  the  Direction  Control  Test  were  signif- 
icantly related  to  the  pass-fail  criterion  and  the 
flight  failure  elimination  criterion  in  primary 
training  (see  Figure  3.4-13). 

^'’Samples  were  Air  Force  officer  trainees  who 
graduated  from  the  School  of  Military  Science- 
Officer  and  entered  undergraduate  pilot  training. 


MDC  E1634  • 29  APRIL  1977 


3-72 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


MCOOMMELL  OOUCLAS 


3. 4. 2. 6 Situational  Tests  - These  tests  use 
situations  riwdeled  after  those  expected  to 
occur  on  the  job.  This  type  of  testing  not  only 
permits  measurement  for  possession  of  the  requisite 
skills  but  also  for  factors  such  as  motivation  to 
perform  and  directionality  of  effort,  i.e.,  whether 
or  not  energy  is  channeled  into  goal -oriented 
behavior  (Fiske,  1954;  Weislogel,  1954).  In  common 
with  the  job  sample  approach,  this  type  of  testing 
also  allows  for  the  complex  interaction  of  abili- 
ties (Fiske,  1954). 

• Unfortunately,  only  one  study  was  found  which 
addressed  the  validity  of  this  approach.  Weislogel 
(1954)  reviewed  two  studies  conducted  by  the  Ameri- 
can Institutes  for  Research.  Both  of  these  studies 
focused  upon  leadership  tests.  In  the  first  study, 
a Leadership  Reaction  Test  was  given  to  516  soldiers 
enrolled  in  a Leadership  Course  at  two  Army  posts. 
This  was  a field  test  staged  in  maneuver  territory. 
Scores  consisted  of  observer  ratings  of  behavior 
(classified  as  effective  or  ineffective).  The  cor- 
relation between  these  scores  and  leadership  ratings 
(a  composite  of  peer  and  faculty  ratings)  was  .46. 

In  the  second  study,  343  Air  Force  Officer 
Candidates  were  given  the  Conference  Table  Test 
which  consisted  of  16  conference-type  leadership 
situations.  Scores  were  observer.,  ratings  of  behav- 
ior as  effective  or  ineffective.  These  scores  had 
correlations  of  .21  with  leadership  ratings  by 
flightmates,  .24  with  leadership  ratings  by  tacti- 
cal officers,  and  .25  with  final  military  class 
grade. 

Although  data  are  scarce,  it  appears  that  this 
approach  may  merit  further  development.  For 
example,  Berkun,  Bialek,  Kern,  and  Vagi  (1962) 
found  this  type  of  approach  valuable  for  inducing 
psychological  stress  as  indicated  by  behavioral 
and  physiological  measures.  Among  the  situations 
producing  the  strongest  stress  reactions  were  a 
simulated  aircraft  emergency  and  a simulated  dis- 
ruption of  a military  exercise  by  misdirected  artil- 
lery shells.  Although  no  validity  data  were  pro- 
vided, these  data  suggest  that  this  may  be  a 
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sensitive  tool  for  measuring  differences  in  reaction 
to  stress  in  candidates  for  pilot  training. 

3.4.3  Multiple  Prediction  - Studies  reviewed 
in  this  section  are  concerned  with  the  prediction 
of  success  in  pilot  training  from  more  than  one 
variable.  Typically,  predictors  are  chosen  from 
several  domains. 

In  some  cases,  fairly  strong  relationships  have 
been  found,  with  several  studies  reporting  multiple 
correlation  values  in  excess  of  .50  (see  Figure 
3.4-14).  For  example,  Levine  and  Tupes  (1952), 
using  a combination  of  aptitude,  biographical,  and 
motivational  variables,  found  correlations  of  .61 
with  the  motivational  elimination  criterion,  .62 
with  the  flight  failure  elimination  criterion,  and 
.51  with  the  administrative  elimination  criterion 
in  training. 

0-^  special  interest  are  studies  which  have 
addressed  the  question  of  whether  or  not  addition 
of  a new  variable  signif icantly  increases  the  mul- 
tiple correlation  found  with  selection  tests 
currently  in  use.  From  this  type  of  analysis,  one 
can  determine  whether  a variable  is  accounting  for 
presently  unexplained  variance  in  the  criterion 
measure. 

Selection  tests  currently  used  by  the  Navy 
include  the  Aviation  Qualifying  Test  (AQT),  Mechan- 
ical Comprehension  Test  (MCT),  Spatial  Appercep- 
tion Test  (SAT)  and  the  Biographical  Inventory  (BI). 
Multiple  correlations  obtained  with  these  measures 
have  been  significantly  augmented  by  the  addition 
of  several  biographical  variables.  Wherry  and 
Hutchins  (1965)  computed  multiple  correlations 
obtained  with  several  selection  variables  (age, 
education,  AQT,  SAT,  MCT,  BI,  and  preflight  vari- 
ables) using  the  pass-fail,  voluntary  withdrawal 
elimination,  and  flight  failure  elimination  cri- 
teria. These  correlations  were  computed  with  both 
officer  and  nonofficer  samples.  In  four  of  six 
cases,  significant  increases  in  multiple  correla- 
tion values  were  found  when  procurement  source  was 
included  as  a predictor.  Similarly,  Bale  and 
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FIGURE  3.4-14  STATISTICAL  RESULTS  OF  FIXED  WING  PILOT  SELECTION  STUDIES  USING  MULTIPLE  CORRELATION  FOR  THE  PRI 
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Ambler  (1971)  found  that  biographical  inventory 
scores  (Flight  Background  Inventory  and  College 
Background  Inventory)  significantly  augmented 
present  selection  variables  in  predicting  the  pass- 
fail  and  voluntary  withdrawal  elimination  criteria 
(see  Figure  3.4-14). 

Three  other  variables  reportedly  augment  pres- 
ent Navy  selection  variables.  Fleischman,  et  al , 
(1966)  assessed  whether  personality  inventory 
scores  (Taylor  Manifest  Anxiety  Scale,  Alternate 
Manifest  Anxiety  Scale,  Pensacola  Z Scale,  Adjec- 
tive Check  List,  and  Catell's  16  Personality  Factor 
Questionnaire)  augmented  prediction  from  selection 
variables  (AQT,  MCT,  SAT,  BI,  preflight  grades, 
and  peer  ratings).  Multiple  correlations  with 
three  criteria  (pass-fail;  flight  failure  elimin- 
ation, and  voluntary  withdrawal  elimination)  were 
significantly  increased  by  the  addition  of  these 
personality  variables  (see  Figure  3.4-14). 

Waag,  Shannon,  and  Ambler  (1973)  found  that 
instructor  ratings  (ratings  on  Probability  of 
Getting  Wings,  Motivation,  Headwork,  and  Reaction 
to  Stress)  increased  the  validity  derived  from 
selection  variables  (AQT,  MCT,  SAT,  BI,  and  grades 
available  before  primary  training).  With  a sample 
of  Aviation  Officer  Candidates,  the  multiple  corre- 
lation with  the  pass-fail  criterion  was  .24  exclud- 
ing instructor  ratings  and  .32  with  the  inclusion 
of  these  ratings.  These  correlations  were  .25  and 
.30,  respectively,  with  a sample  of  Officers  under 
Instruction.  Both  correlations  were  significantly 
increased  by  the  addition  of  instructor  ratings. 

Finally,  Berkshire,  et  aj^,  (1963)  found  that 
Flight  Indoctrination  Program  (FIP)  grades  (instruc- 
tor ratings  and  flight  grades)  increased  the  pre- 
diction of  several  criteria  derived  from  the  AQT 
and  Flight  Aptitude  Rating.  Criteria  were  pre- 
flight grade,  primary  flight  grade,  final  overall 
grade,  flight  failure  elimination,  ground  failure 
elimination,  voluntary  withdrawal  elimination, 
and  pass-fail.  With  the  exception  of  the  ground 
failure  elimination  criterion,  all  multiple  corre- 
lations were  significantly  increased  with  the 
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addition  of  FIP  grades.  For  example,  the  multiple 
correlation  with  the  pass-fail  criterion  was  .24 
excluding  FIP  grades  and  .39  with  the  inclusion  of 
these  grades. 

Both  sensory-motor  and  job  sample  measures 
have  been  found  to  enhance  prediction  from  the 
Air  Force  Officer  Qualifying  Test  (AFOQT),  a selec- 
tion test  currently  used  by  the  Air  Force.  McGrevy 
and  Valentine  (1974)  reported  significant  increases 
in  multiple  correlations  with  the  pass-fail  cri- 
terion when  sensory-motor  test  scores  (Two-Hand 
Coordination  and  Complex  Coordination)  were  added 
to  the  predictors.  In  one  study,  the  multiple 
correlation  was  .37  excluding  these  sensory-motor 
scores  and  .56  with  their  inclusion.  Similarly, 
in  a second  study,  addition  of  scores  on  Complex 
* Coordination  significantly  augmented  prediction 
of  the  pass-fail  criterion. 

Long  and  Varney  (1975)  contrasted  the  validity 
of  job  sample  measures  and  Air  Force  Reference 
measures  as  predictors  of  grades  in  the  T-41  phase 
of  training.  Air  Force  Reference  measures  were  six 
factor  scores  derived  from  a Reference  Battery, 
Psychomotor  Battery,  and  the  AFOQT.  Job  sample 
measures  were  20  factor  scores  derived  from  a large 
number  of  maneuver  scores  on  a modified  GAT-1 
trainer.  Multiple  correlations  with  grades  (fair 
or  deficient  versus  excellent  or  waivered)  were 
.52  when  Reference  measures  were  included  and  .28 
and  .41  (with  different  sample  sizes)  without  these 
Reference  measures.  Therefore,  job  sample  measures 
alone  yielded  fairly  high  correlations  with  T-41 
grades.  In  addition,  relatively  high  correlations 
were  reported  between  job  sample  measures  and  the 
pass-fail  and  flight  failure  elimination  criteria 
in  T-41  and  T-37  phases.  Similarly,  LeMaster  and 
Gray,  (1974)  found  that  job  sample  measures  enhanced 
prediction  from  the  AFOQT  with  two  criteria  (see 
Figure  3.4-14). 

In  summary,  these  studies  suggest  that  the 
prediction  of  success  in  training  within  the  Navy 
and  Air  Force  can  be  markedly  improved  with  the 
addition  of  factors  to  present  selection  methods. 
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These  factors  include  instructor  ratings,  FIP 
grades,  sensory-motor  and  job  sample  measures, 
and  biographical  and  personality  variables. 

3.4.4  Statistical  and  Methodological  Issues  - 
In  the  introduction  to  Section  3.4,  the  reader  was 
urged  to  exercise  caution  in  interpreting  this 
literature,  especially  in  cases  where  repeated 
statistical  tests  were  used  (e.g.,  more  than 
one  correlation  or  t test  is  computed  on  a single 
set  of  data).  The  problem  posed  is  that  the  prob- 
ability of  obtaining  a significant  result  by  chance 
increases  as  you  increase  the  number  of  tests  or 
comparisons  (Kirk,  1968).  For  example,  when  the 
comparisons  are  independent,^“  this  probability 
may  be  obtained  by  the  formula; 

1 - (1-a)'^ 

where  « = the  level  of  significance 

C = the  number  of  comparisons  made. 

Consequently,  when  adopting  a .05  « level,  the 
effective  u level  is  approximately  .0975  when  two 
comparisons  are  made,  .1426  when  three  comparisons 
are  made,  etc.  Therefore,  as  the  number  of  tests 
increases,  the  number  of  spurious  differences  also 
increases.  This  statistical  problem  was  a frequent 
one  among  studies  reviewed  in  Sections  3.4.1  and 
3.4.2.  One  solution  is  to  use  multivariate  tech- 
niques, one  of  which  is  the  multiple  correlation 
employed  in  studies  reviewed  in  Section  3.4.3.31 

A second  statistical  difficulty  is  posed  by 
the  restricted  range  present  in  the  majority  of 
studies  reviewed.  Typically,  analyses  were  computed 
on  samples  of  candidates  selected  for  entrance  into 
pilot  training.  These  are  relatively  homogeneous 
populations.  The  effect  of  a restricted  range  is 
to  artifically  lower  the  magnitude  of  the  correla- 
tion (McNemar,  1969).  Thus,  correlations  reported 
are  under-estimates  of  the  degree  of  relationship 
between  variables.  Although  techniques  are  avail- 
able to  correct  for  a restricted  range  (McNemar, 
1969),  they  have  rarely  been  applied. 32 

As  noted  in  the  introduction,  most  studies 
have  favored  a pass-fail  type  of  criterion  for 


success  in  training.  The  pass-fail  criterion  only 
allows  for  relatively  crude  evaluations.  No  dis- 
tinction is  made  oecwcen  those  candidates  who  have 
great  difficulty  succeeding  and  those  who  progress 
through  pilot  training  with  little  or  no  difficulty 
(McGehee,  1951;  Rosenberg,  1954).  Rosenberg  (1954) 
suggests  time  to  complete  training  as  a more  useful 
criterion  in  that  it  would  permit  this  distinction. 
At  a more  general  level,  Dunnette  (1963)  recommends 
that  we  use  multiple  measures  of  behavior  rather 
than  focusing  on  a single  criterion.  This  seems 
to  be  a reasonable  approach  to  selection  when  we 
consider  the  complexity  of  the  problem.  Flying 
fighter  planes  is  a complex  skill,  and,  as  such, 
it  may  be  more  efficient  to  look  at  several  cri- 
teria, each  tapping  different  components  of  this 
ability. 

Finally,  as  noted  by  McGehee  (1951),  often 
there  is  no  evaluation  of  selection  methods  beyond 
training.  This  is  evidenced  by  the  paucity  of 
combat  research  reviewed  in  Sections  3.2  and  3.3. 
Presumably,  the  purpose  of  selection  is  to  guaran- 
tee success  on  the  job,  not  just  success  in  train- 
ing. An  implicit  assumption  in  the  training 
research  is  that  there  is  a strong  relationship 
■between  success  in  training  and  success  in  combat. 
However,  this  assumption  is  not  necessarily  valid 
(see  Section  3.2.1). 

In  reviewing  these  issues,  it  is  not  our 
intent  to  discredit  training  research.  Indeed, 
these  data  are  used  as  one  source  for  hypothesis 
generation  (see  Section  4).  The  purpose  of  this 
evaluation  is  to  point  out  some  of  the  areas  which 
can  be  markedly  improved  upon  in  subsequent  selec- 
tion research.  Host  important  of  all  is  the  need 
for  combat -related  validation  studies. 

33independent  comparisons  are  those  which  are 
orthogonal,  i.e.,  information  used  in  the  compar- 
isons is  nonoverlapping  (Kirk,  1968). 

3'Appl ications  of  other  multivariate  techniques 
may  be  found  in  Lockman  (1953,  1955)  and  Thaler 
(1970). 

3^Exceptions  include  studies  done  within  the 
Army  Air  Force's  Psychology  Program. 
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3.4.5  Sunmary  - Since  World  War  II.  a large 
variety  of  predictors  has  been  studied  in  relation 
to  criteria  of  success  in  pilot  training.  These 
predictors  fall  within  13  distinct  content  domains. 
Seven  of  these  domains  focus  on  characteristics 
(aptitude,  biographical,  medical,  motivational, 
personality,  reaction  to  stress,  and  social  factors), 
whereas  six  domains  deal  with  critical  skills  for 
fighter  pilots  (aviator  skills,  knowledges,  and 
tasks;  information  processing  rate;  job  sample 
measures;  light  plane  measures;  sensory-motor 
skills;  and  measures  in  situational  tests).  Most 
studies  reviewed  have  employed  a pass- fail  type  of 
cri  terion. 

Although  statistical/methodological  problems 
are  present  in  many  of  these  studies  (e.g.,  the 
use  of  repeated  statistical  tests,  failure  to  cor- 
rect for  a restricted  range,  and  insensitivity  of 
the  pass-fail  type  of  criterion),  several  conclu- 
sions may  be  drawn.  With  the  exception  of  medical 
factors  (physical  fitness  test  scores)  and  most 
paper-and-pencil  measures  of  reaction  to  stress, 
these  categories  of  predictors  have  shown  relation- 
ships to  or  have  shown  potential  for  the  prediction 
of  criteria  of  success  in  pilot  training. 

Multiple  prediction  studies  (i .e. , studies 
concerned  with  the  prediction  of  success  in  train- 
ing from  more  than  one  predictor)  have  been  the 
most  revealing.  These  studies  found  that  the  pre- 
diction of  training  success  can  be  significantly 
augmented  by  adding  several  factors  to  current 
selection  measures.  These  factors  include  instruc- 
tor ratings.  Flight  Indoctrination  Program  grades, 
sensory-motor  and  job  sample  measures,  and  biograph- 
ical and  personality  variables.  These  data  are 
employed  in  Section  4 to  generate  a profile  of  the 
combat  effective  fighter  pilot. 


^^More  detailed  summary  statements  may  be  found 
at  the  end  of  Subsections  3. 4. 1.1  to  3. 4. 1.7  and 
3.4.2. 1 to  3. 4. 2. 6,  respectively. 
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3.5  FOREIGN  PILOT  SELECTION  PROGRAMS 

Three  foreign  fighter  pilot  selection  programs 
will  be  considered  in  this  section:  the  current 

Israeli  program,  and  the  German  and  Japanese  pro- 
grams of  World  War  II. ^ A significant  factor  to 
bear  in  mind  as  we  review  these  foreign  pilot  selec- 
tion programs  is  that  none  of  them  has  scientifi- 
cally correlated  selection  tests  with  ultimate 
fighter  pilot  combat  effectiveness.  Nevertheless, 
we  feel  that  each  of  these  programs  is  worthy  of 
review.  The  Israeli  program  includes  some  assess- 
ment techniques  not  used  in  other  pilot  selection 
programs,  and  the  review  of  foreign  programs  during 
World  War  II  identify  certain  pitfalls  which  might 
be  avoided.  The  factors  tested  for  in  these  pro- 
grams, at  least  by  implication,  provide  another 
source  of  information  upon  which  we  can  build  a 
comprehensive  profile  (hypotheses)  of  the  combat 
effective  fighter  pilot  which  we  will  integrate  and 
show  in  Section  4 of  this  document. 

Our  discussion  of  the  Israeli  program  is  un- 
classified. It  has  been  pieced  together  from  the 
open  literature  and  a personal  interview  with  an 
Israeli  selection  specialist^  who  had  received 
prior  permission  to  discuss  unclassified  details 
of  the  Israeli  fighter  pilot  selection  program 
with  us.  The  German  and  Japanese  programs  of 
World  War  II  were  reported  upon  by  prominent 
American  psychologists  shortly  after  the  cessation 
of  hostilities  with  these  countries  (Fitts,  1946; 
Geldard  and  Harris,  1946). 

3.5.1  The  Israeli  Program  - In  terms  of 
combat  effectiveness,  many  consider  the  Israeli 
Air  Force  (lAF)  to  be  the  finest  in  the  world.  If 
the  Israeli  air-to-air  combat  claims  are  to  be 
believed  (60  to  1)  then,  indeed,  they  are  in  a class 
by  themselves  (Cook,  1972).  Many  factors  undoubt- 
edly contribute  to  this  combat  effectiveness  aggre- 
gate, including  the  relatively  constant  weather  and 
terrain  conditions,  the  Israelis’  knowledge  of  their 
enemies,  the  constant  state  of  national  military 
alert,  the  high  state  of  pilot  readiness,  (pilots 
are  reported  to  make  400  to  500  air  combat  sorties 
per  year)  as  well  as  an  underlying  state  of 

MDC  E1634  • 29  APRIL  1977 


national  pride  and  motivation.  One  other  element 
that  may  be  contributing  to  the  combat  effective- 
ness of  the  Israeli  air-to-air  combat  fighter  pilot 
is  the  lAF  pilot  selection  program. 


The  Israeli  selection  specialist  we  inter- 
viewed was  quick  to  point  out  to  us  that  any 
appraisal  of  the  Israeli  selection  and  training 
program  should  be  conducted  with  an  awareness  of 
the  Israelis'  unique,  sociopolitical  environment. 
Within  this  context,  the  Israeli  pilot  is  con- 
sidered the  most  elite  of  all  of  their  fighting 
arms.  Additionally,  any  consideration  of  the 
Israeli  program  must  start  from  an  appreciation 
of  the  fact  that  they  hive  universal  military  ser- 
vice. 


Before  describing  the  lAF  pilot  selection  and 
training  program,  let's  look  at  a quote  drawn  from 
an  Air  University  Study  by  Cook  (1972). 


"What  the  Israelis  have  learned  is  that  in 
an  air  force,  numbers  are  not  important... 
quality  is  the  deciding  factor.  Major  Gen- 
eral Ezer  Weizman,  former  Air  Force  Chief, 
wft)te  prophetically  in  1962  that  numbers 
don't  count;  only  effective  missions  do. 

If  one  can  match  the  enemy  sortie  for  sortie, 
then  the  outcome  will  be  determined  primarily 
by  the  competence  of  the  pilots.  This  phil- 
osophy accounts  for  the  concentration  of 
interest  on  men  rather  than  machines;  or, 
as  he  put  it;  '.  . .In  an  age  of  sophisti- 
cated weapons  we  try  to  make  the  man  in  the 
cockpit  count  above  everything....' 

"It  was  Weizman  who  insisted  that  the  French 
build  cannons  into  the  Mirages  the  Israelis 
ordered  in  1958-1959  even  though  the  super- 
sonic jets  had  been  designed  to  carry  only 
missiles.  He  wanted  cannons  not  only  because 
they  are  simple,  reliable  and  comparatively 
inexpensive  weapons,  but  also  because  guns 
can  serve  a dual  purpose:  they  are  extremely 

effective  in  both  aerial  and  ground  attack 

"Effective,  that  is,  if  the  pilots  are  highly 
skilled;  and  it  is  upon  just  this  premise 
that  Brigadier  General  Mordecai  Hod,  current 


'For  reviews  of  other  foreign  aircrew  selec- 
tion programs,  see  Air  Ministry  (1947),  Manning 
and  Yellowlees  (1949),  Parry  (1947),  Signori 
(1949),  Tromp  (1962),  Vernon  and  Parry  (1949), 
Want  (1962),  and  Wooton  (1972). 

“"A  professionally  trained  and  experienced 
experimental  psychologist. 
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lAF  commander,  has  built  his  combat  doctrine. 
Aerial  tactics  are  planned  on  the  basic 
assumption  that  Israeli  pilots  are  far  super- 
ior to  the  enemy.  In  General  Hod's  opinion, 
two  lAF  a1rcraft--a  leader  and  a wingman  to 
keep  him  clear--  are  sufficient  for  any  aerial 
battle,  no  matter  how  many  enemy  aircraft  are 
Involved.  Like  Weizman,  he  feels  that  '... 
over-sophistication,  computerized  answers, 
systems  analysis  and  cost  effectiveness  have 
brought  the  flying  world  away  from  the  few 
sound  basic  principles  of  air  war ' 

"Consequently,  the  emphasis  Is  upon  Indi- 
vidual excellence,  courage,  and  a deep  sense 
of  personal  responsibility;  and  these  are  the 
qualities  the  lAF  seeks  to  Instill  In  Its 
pilots  during  their  training 

The  Israelis  have  established  a pilot  train- 
ing program  that  Is  both  Intensive  and 
costly;  It  takes  about  20  months  and  approxi- 
mately $150,000  to  train  one  Israeli  fighter 
pilot.  By  contrast,  our  present  48  week  UPT 
program  costs  $85,970.  Applicants  are  meti- 
culously chosen  only  from  the  best  of  the 
country's  young  men.  Although  college  Is  not 
required,  all  must  have  completed  high  school 
and  all  must  be  volunteers.  Most  are  about 
18  years  old  and  more  than  half  come  direct 
from  the  kibbutzim.... 

"The  screening  process  Is  extremely  rigorous; 
although  the  Israelis  have  neither  confirmed 


nor  denied  It,  several  observers  have  report- 
ed that  only  one  out  of  300  entrants  actually 
becomes  an  Israeli  pilot.  Much  of  the  screen- 
ing Is  based  on  Intense  psychological  testing 
on  the  ground,  personally  observed  by  Instruc- 
tor pilots  as  well  as  psychologists.  Cadets 
In  groups  are  assigned  physical  problems— 
such  as  getting  everyone  across  a small 
stream  within  a certain  time  limit — using 
only  the  materials  at  hand.  Instructors  can 
thus  determine  at  first  hand  which  ones  pos- 
sess qualities  of  leadership  and  Innovation. 
Flexibility  and  the  ability  to  improvise  are 
more  highly  prized  than  simply  the  capability 
to  follow  procedures."  (pp.  36-38) 

In  an  overview.  Cook  (1972)  has  captured  the 
essence  of  the  lAF  pilot  selection  and  training 
program.  More  detail  Is  given  In  Figure  3.5-1 
which  shows  an  overview  of  the  Israeli  pilot  se- 
lection and  training  program  from  the  initial  test- 
ing through  ultimate  assignment  to  operational 
air-to-air  fighter  aircraft. 

The  selection  process  starts  when  Israeli 
boys  reach  the  age  of  17  1/2  years.  The  lAF  which 
has  first  call  on  these  Individuals,  uses  four 
Initial  selection  (screening)  criteria.  They  are: 
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0 They  must  be  volunteers  {Some  are  selected 

0. 1  the  basis  of  their  test  scores  but  may 
drop  themselves  from  consideration.) 

0 They  must  be  medically  fit 

0 They  must  "pass"  two  I.Q.  tests  (the  Raven 
Matrices,  a non-verbal  embedded  figures 
test;  and  the  Otis,  which  gives  a verbal 

1. Q.  Measure)  (Candidates  need  only  be  of 
average  intelligence  to  go  forward.) 

0 Candidates  must  have  ten  years  of  formal 
school ing  (This  seemingly  low  requirement 
was  specifically  instituted  in  order  that 
pilot  candidates  from  the  various  kibbut- 
zim would  not  be  eliminated.) 

Candidates  who  pass  this  initial  screening  are 
tested  again  immediately  following  induction  at  18 
years  of  age.  The  following  tests  are  administered 
at  this  time: 

a.  A paper-and-penci 1 , forced  choice,  mecha-- 
nical  comprehension  test. 

b.  A mechanical  comprehension  test  involving 
assembly  of  a small  mechanical  apparatus. 

c.  An  eye/hand  coordination  test.  This  con- 
sists of  a pencil  through  a maze  test  in 
which  time  and  accuracy  are  measured. 

Only  a small  number  drop  out  at  this  stage, 
while  the  remaining  go  on  to  the  Institute  of 
Aviation  Research  Medicine  facility.  Two  additional 
paper-and-penci 1 psychological  tests  are  administered 
at  this  point.  The  first  consists  of  a detailed 
background  and  life  inventory  test  hitting  at  ele- 
ments of  school,  home,  health,  Israeli  youth  move- 
ment participation,  sports,  interests,  hobbies, 
likes  and  dislikes,  critical  incidents,  and  personal- 
ity types  they  identify  and  do  not  identify  with. 
Secondly,  they  take  five  kinds  of  personality  tests. 
They  include: 


a.  A Thematic  Apperception  Test  (TAT)  that 
is  specially  contrived  to  deal  with  avia- 
tion bias,  for  example,  an  aircraft  crash. 
This  is  an  open-ended  projective  test. 
(Historically,  they  used  Rorschach  tests, 
but  this  practice  had  been  terminated.) 

b.  Draw  a Man  tests. 

c.  Sentence  completion  tests. 

d.  The  scales  of  the  Eysenck  personality 
test  are  used.  These  are  the  introvert/ 
extrovert  scale  and  the  neuroticism  scale. 

e.  The  Taylor  Manifest  Anxiety  scale. 

Once  these  tests  are  completed,  they  are 
"worked  up"  by  clinical  psychologists  and  reviewed 
by  a senior  clinician  or  a psychiatrist.  This 
individual,  armed  with  all  of  the  selection  data 
gathered  to  this  point,  then  interviews  the  candi- 
date and  assigns  him  a selection  rating.  At  this 
stage,  the  selection  rating  is  based  40  upon  the 
candidate's  personality,  including  the  psychologi- 
cal work-up,  30"/  upon  the  perceptual /motor  tests 
and  30%  upon  background  variables  (the  predictive 
power  of  these  tests  was  described  as  "modest"  with 
respect  to  predicting  success  in  pilot  training). 

Those  accepted  for  pilot  training  skip  the 
normal  basic  training  given  to  others  entering  the 
Israeli  Army  and  go  directly  to  a lO-day  "tent 
city"  testing  program  which  employs  a new  team  of 
research  scientists  and  pilots.  During  this  period, 
candidates  live  in  tents  and  are  subjected  to 
rigorous  environmental  stress.  One  complete  day 
is  spent  in  a field  test  involving  obstacles  and 
group  activities.  The  pilot  candidates  are  con- 
stantly observed  by  teams  of  pilots  and  sociolo- 
gists. At  the  end  of  this  period,  a new  selection 
rating  is  generated  involving  the  following  domains: 
(1)  general  motivation.  (2)  officer  training  field 
tests,  and  (3)  two  sociometric  scales  called  the 
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"pilot"  scale  and  the  "friend"  scale.  These  rat- 
ings are  combined  with  the  candidates'  earlier 
selection  ratings,  and  a final  decision  is  made  on 
each  candidate. 

The  general  philosophy  preceding  the  10  day 
testing  period  has  been  to  keep  the  selection 
standards  relatively  modest.  However,  at  the  con- 
clusion of  the  10  day  testing  program,  roughly  50* 
of  the  candidates  are  washed  out  and  returned  to 
other  Army  activities  (Brown,  1976). 

The  Israeli  selection  specialist  commented  on 
a number  of  the  selection  domains  that  we  thought 
might  be  potentially  important  for  predicting 
combat  effectiveness.  His  comments  are  shown  in 
Figure  3.5-2  with  respect  to  the  domains  of  intelli- 
gence, physical  and  mental  health,  risk  taking, 
personality,  motivation,  aggressiveness,  courage, 
stress  behavior,  leadership,  tactical  judgement, 
and  decision  making.  According  to  Brown  (1976), 
the  Israeli  selection  continues  in  the  two-year 
pilot  training  program.  After  nine  flights  in  the 
first  four  month  course,  about  20*  of  the  candidates 
are  rejected.^  The  80%  surviving  that  cut  go  on  to 
four  months  of  infantry  training.  During  the  first 
eight  months,  an  informal  selection  process  takes 
place  so  that  the  most  promising  students  enter  the 
fighter  pilot  program,  the  second  group  of  students 
trains  for  helicopters,  and  the  remaining  students 
enter  navigator  training.  During  primary  and  basic 
flight  training,  in  which  another  10%  of  those  who 
started  training  are  eliminated,  two  separate  lines 
of  cadets  are  developed.  One  is  that  of  the  career 
officer  and  the  other  is  for  sergeant-pilots  who 
serve  for  a period  of  only  a few  years.  Following 
basic  flight  training,  the  pilots  proceed  through 
advanced  training.  Brown  (1976)  notes  that  all  of 
the  fighter  pilots  spend  at  least  eighteen  months 
flying  the  A-4  before  being  selected  to  transition 


^The  Israelis'  selection  specialist  regarded 
this  as  somewhat  inefficient  and  would  eventually 
hope  to  assign  pilots  directly  to  fighters,  trans- 
ports or  other  aircraft  at  the  end  of  the  preced- 
ing 10  day  testing  period. 

MDC  E1634  • 29  APRIL  1977 


9 1017 

• Genenl  intellitaict.  This  Is  covned  in  the  eitly  sU(e  ol  teslini  usini  the  Raven 
and  Otis  instiuments.  Inleiestin(ly,  it  has  been  found  that  attei  that  state  it  is  ol 
no  predictive  power. 

• Physical  health.  Until  1973  extiemely  hitfi  physical  health  medical  standards 
weie  imposed  upon  the  aviation  community.  Post  '73  standards  have  been  relaxed. 

For  example,  back  seal  personnel  may  now  near  classes. 

• Mental  Health.  The  clinical  approach  is  used  in  the  early  teslini  propam  and  not 
formally  looked  at  aiain.  Lite  inventory  questions  are  also  used  durinc  early 
teslini  which,  in  some  cases,  tap  mental  health.  These  factors  may  enter  durini 
later  selection  periods,  particularly  where  instructor  pilots  are  ratine  the  candi- 
dates inasmuch  as  they  are  thouiht  to  prefer  a certain  stereotype.  For  example, 
many  pilots  lenerally  prefer  candidates  Irom  kibbutzim. 

• Risk  takini.  The  Israelis  have  never  investiialed  this  domain. 

• Personal i tv.  Israeli  teslini  continues  throu|houl  IliMil  school  where  weekly 
meelinis  are  held  to  discuss  mariinal  candidates.  At  this  point  in  time  it  is  felt 
that  the  pilots  are  stionily  influenced  by  the  candidate's  personality,  perhaps 
even  more  than  his  IliMit  skills. 

• Motivation.  This  has  never  been  a problem.  Everyone  makinc  it  to  pilot  trainini 
is  considered  very  hiihly  motivated.  Those  who  are  not  sironily  motivated  are 
thou|ht  to  take  themselves  out  of  the  propam  early  on.  Motivation  is  a poup 
motivational  phenomena  in  Israel  as  opposed  to  more  individualistic  motivation 
in  the  United  States. 

• Aiiressiveness  and  determination.  These  are  never  measured  lormally.  However, 
they  are  considered  inlormally  in  flicht  school.  The  same  comments  could  be 
made  lor  our  determination  domain. 

• Couraie.  This  is  taken  lor  panted  but  reflected  only  in  a man's  ultimate  combat 
performance.  Since  Israeli  conflicts,  until  the  1973  period,  were  considered  a walk 
over,  couraie  was  never  raised  as  an  issue.  With  the  increase  in  ellective  SAM 
sites  durinc  the  1973  operation  this  has  become  an  issue.  While  air  combat  maneu- 
verini  ranees  provided  the  ultimate  surrotale  combat  environment,  these  were  not 
effective  tests  ol  couraie. 

• Stress.  Behavior  under  stress  is  tested  durinc  the  ten  day  testini  period  and 
formal  observers  are  used. 

• Leadership.  Leadership  is  one  ol  the  items  considered  in  the  peer  ratine  occurini 
at  the  end  of  the  ten  day  teslini  period.  The  pilot  scale  ol  this  peer  ratine  in- 
strument is  the  best  predictor  ol  success  in  lli|ht  school. 

« Tactical  JudiemenL  This  has  never  been  assessed. 

• Decision  Makini,  Preliminary  research  nas  been  |oin|  on  lor  over  three  years  in  the 
leneral  area  ol  information  ptocessini  and  measures  of  attention. 

FIGURE  3.5-2  THIS  FIGURE  SHOWS  AN  ISRAELI  SELECTION 
SPECIALIST'S  COMMENTS  ON  TWELVE  POTENTIAL  PRE- 
OICTORS  OF  PILOT  COMBAT  EFFECTIVENESS 
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into  the  F-4,  Kfir,  or  Dassault- Breguet  Mirage.'* 

If  a pilot  should  attend  the  university,  he 
must  fly  with  his  operational  squadron  as  fre- 
quently as  practicable,  about  once  a week.  Israeli 
squadron  life  also  fosters  combat  effectiveness. 

It  appears  to  be  patterned  somewhat  after  the  RAF, 
inasmuch  as  the  squadron  forms  a work/home  social 
subculture  complete  in  Itself  with  very  high  inter- 
and  intra-squadron  competition  being  the  rule. 

3.5.2  The  World  War  II  German  Program  - A 
review  of  the  German  pilot  selection  program  of 
World  War  II,  is  contained  in  an  article  by  Fitts 
(1946).  This  subsection  is  based  upon  that  report. 

In  1939,  the  first  year  of  existence  of  the 
Luftwaffe,  the  German  Air  Forces  testing  program 
was  expanded  (Fitts,  1946).  This  program  was  con- 
tinued until  February  of  1942  when  the  entire  selec- 
tion program  was  discontinued  at  the  order  of 
Reichsmarshal  Goering.  After  that,  recruiting 
officers  and  medical  examiners  performed  selection 
and  classification  duties.  Selection  tests  were 
given  at  three  types  of  testing  centers,  recruiting 
centers  for  Air  Force  Officers,  recruiting  and  de- 
mobilizing centers,  and  regimental  testing  centers. 
These  are  briefly  described  in  Figure  3.5-3. 
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• Rttniilini  Caileis  for  Air  Forces  Oflicets.  Centeis  in  Berlin,  Hinovet,  Munich,  end 
Vienna  five  examinations  to  boys  of  school  a|e  imho  wanted  to  become  ollicers  in 
the  German  Air  Forces.  Emphasis  was  on  testini  lor  ollicer  quality,  but  special 
aptitude  tests  lor  aircrew,  antiaircraft  and  communications  assipiments  were  (iven 
also. 

• Recruitini  and  Demobilnini  Centers.  Durini  most  of  the  war  there  were  nine  Air 
Districts  in  Germany,  and  each  had  a center  where  both  military  and  civilian  volun- 
teers lor  assipment  as  specialists  in  the  Air  Forces  could  be  liven  medical  and 
psychololical  examinations.  A comprehensive  examination  formed  the  basis  lor 
decisions  concernini  selection  and  recommendations  as  to  classilicalion  lor  en- 
listed pilot,  bombardier,  naviplor,  pnner,  mechanic,  antiaircrall,  communications 
or  paratrooper  trainini. 

• Reiimenlal  Testini  Centers.  Soon  alter  the  be|innin|  of  the  war,  psycholofists 
were  assiped  to  each  of  the  refimenis  in  the  Air  Forces  where  basic  military 
trainini  was  liven.  While  at  these  tralninl  reiiments,  individuals  who  had  been 
drafted  into  military  service  were  tested  for  the  first  time,  and  volunteers  who  had 
been  tested  at  another  center  often  were  re-examined.  Final  classilicalion  was  ac- 
complished at  this  time.  Authority  lor  assipment  ol  personnel  rested  with  the 
re|imental  commanders,  however,  and  not  with  the  psycholo|ists, 

FIGURE  3.5-3  THIS  FIGURE  SHOWS  THE  THREE  TYPES  OF 
GERMAN  TESTING  CENTERS  FOR  PILOT  SELECTION 
(FITTS,  1946,  PP.  152-153) 


Noting  that  the  typical  post  World  War  I 
German  believed  that  the  intangible  aspects  of 
character  were  more  important  than  aptitude  or 
skill,  Fitts  (1946)  indicated  that  the  clinical 
assessment  of  leadership,  character,  and  personal- 
ity was  the  major  purpose  of  the  psychological 
examination.  No  standard  battery  of  tests  was 
used,  but  Fitts  (1946)  was  able  to  classify  the 
tests  into  five  basic  categories:  Special  aptitude 

tests,  tests  of  sensory-motor  coordination,  tests 
of  character  and  leadership,  tests  of  perceptual 
ability,  and  tests  of  intelligence  and  judgment. 
These  are  described  briefly  in  Figure  3.5-4. 


According  to  Fitts  (1946).  the  Germans  did 
not  validate  tneir  tests.  This  was  probably  due 
to  the  non-quantitative  methods  which  were  used. 
The  non-quantitative  information  available  was  not 
amenable  to  statistical  analysis.  An  indirect 
effect  of  this  shortcoming  was  the  failure  to  im- 
prove pilot  selection  procedures  during  the  war. 
The  selection  of  pilots  in  1942  was  apparently 
not  substantially  different  from  the  selection  of 
ground  officers  in  the  1920s  (Fitts.  1946). 

Summarizing  their  World  War  II  program,  Fitts 
(1946)  said: 

"...the  points  of  view  and  methods  of 
German  psychologists  were  found  to  be  quite 
different  from  those  of  most  applied  psy- 
chologists in  the  United  States.  Extensive 
use  was  made  of  tests,  but  for  the  most  part 
psychologists  disregarded  exact  test  scores 
and  relied  instead  on  their  clinical  judg- 
ment. The  concepts  of  objectivity,  standard- 
ization, reliability,  and  validity  were 
almost  entirely  lacking.  No  results  of  stud- 
ies comparing  agreement  between  different 
examiners  or  studies  relating  examination 
findings  to  subsequent  success  or  failure  in 


''These  groups  are  small  and  during  this  year, 
virtually  every  pilot  has  an  opportunity  to  fly 
against  two  or  three  of  the  very  best  air-to-air 
combat  pilots  in  Israel.  At  the  end  of  this 
period  selection  of  assignment  to  air-to-air  com- 
bat wings  is,  literally,  on  an  individual  basis. 
According  to  our  Israeli  colleague,  selection 
standards  are  so  high  at  this  juncture  that  in 
certain  periods  no  pilots  are  selected. 
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• Special  Aptitii<«  Tests.  Special  tests  wete  used  la  selectini  heiihMindei,  sound- 
detectof,  and  radio  operators.  Code  learnini  ability  was  measored  by  an  individual 
test  in  wbicb  the  candidate  attempted  to  reproduce  code  sounds  heard  throufh  ear- 
phones. In  a roup  test  of  code  aptitude,  recorded  on  phonoraph  records,  candidates 
judied  whether  paired  code  sounds  wete  the  same  or  dillerent, 

• Tests  of  Sensoti-Plolot  Coordination.  Several  tests  were  used  to  measure  coordina- 
tion and  speed  ol  reaction.  These  tests  were  used  in  predictinp  capacity  lor  learn- 
inc  skills  and  also  in  sbidyini  personality  characteristics.  Included  in  the  roup 
was  a test  in  which  the  candidate  mainipulated  a stick  and  rudder  in  response  to 
lifhl  sirials  from  three  separate  rows  of  lifhts  (similar  In  die  S.  A.  M.  Complei  Co- 
ordination Test,  the  otitinal  model  ol  which  was  developed  at  the  AAF  School  of 
Aviation  Medicine  in  1928);  a test  in  which  the  candidate  responded  to  visual  and 
auditory  sipials  while  strapped  to  the  outer  rim  ol  a larpe  rolatini  vertical  wheel: 

a lest  which  retpiired  balancinp  on  an  unstable  plallorm:  and  a series  ol  sports  tests 
includinf  runninp,  jumpinp,  chinninp,  puttini  the  shot,  and  netotiatini  an  obstacle 
course.  The  Comples  Reaction  test  is  typical  ol  this  (roup.  II  was  considered  by 
most  of  the  psycholofists  who  were  interviewed  to  be  their  best  apparatus  test 
althou|h  no  evidence  on  this  point  was  {iven.  It  was  desir>ed  otiiinally  by  Dr. 
Rieflert  to  measure  ability  to  react  with  both  hands  and  feet  to  a variety  of  visual 
and  auditory  sipnals.  However,  it  was  believed  that  the  coraplesity  of  Ihe  task 
and  rapidity  ol  die  fixed  pace  also  made  it  a valuable  test  ol  temperament  On  a 
larfe  screen  could  be  presented  automatically  one  ol  live  visual  stimuli  which 
varied  bodi  in  color  and  form.  Eidier  a bell  or  a buzzer  also  could  be  sounded.  The 
candidate  was  seated  4 meters  from  the  screen  and  operated  three  large  hand  levers 
and  two  loot  pedals  in  response  to  a series  of  330  visual  and  auditory  stimuli  which 
wete  presented  in  a random  order  and  at  a predetermined  rate  during  a period  ol 
eight  minutes.  Scoring  was  in  terms  of  the  number  of  correct  responses  and  ob- 
servations wete  made  of  general  behavior  during  the  series. 

• Tests  ol  Character  and  Leadership.  Observations  concerning  personality  charac- 
teristics were  made  throughout  the  examination,  but  several  situations  wete  de- 
signed especially  to  test  character  and  leadership  ability.  Character  tests  included 
the  analysis  ol  speech,  voice  and  facial  expression,  and  observation  ol  behavior 
as  the  candidate  neared  physical  exhaustion  on  an  obstacle  course  which  was  im- 
possible ol  completion.  Leadership  tests  included  a group  discussion  in  which 
several  candidates  participated,  and  an  orders  test  in  which  candidates  wete  re- 
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tiuired  to  take  charge  ol  several  assistants  and  direct  them  in  the  accomplishment 
ol  a practical  task.  The  orders  lest  resembled  closely  procedures  adopted  sub- 
sequently 1^  British  Wat  Office  Selection  Boards  and  used  h/  the  OSS  in  (he 
United  States.  The  method  used  in  handwriting  analysis  is  typical  ol  the  group  of 
character  analysis  procedures.  A great  deal  ol  attention  was  given  to  the  study  ol 
handwriting.  Most  ol  Ihe  psychologists  who  were  interviewed  believed  that  the 
method  was  of  considerable  value,  although  admitting  that  techniques  used  in 
analysis  were  subjective  and  unstandardized.  It  was  generally  believed  that  hand- 
writing analysis  also  revealed  intellectual  ability,  temperament,  feeling  and  mood, 
maturity  and  spiritual  qualities. 

• Tests  ol  Perceptual  Ability.  Many  German  theories  assumed  that  individuals 
could  be  typed  on  the  basis  ol  characteristic  ways  ol  perceiving.  Most  perceptual 
tests  were  designed,  therelore,  to  indicate  character  and  personality  structure  as 
well  as  speed  and  accuracy  ol  perception,  A candidate  might  be  required  to  adjust 
a movable  rod  until  it  was  judged  to  be  in  the  same  vertical  plane  as  two  fixed 
hairs,  or  adjust  a vertical  line  while  wearing  special  lenses  in  Iront  ol  his  eyes, 
or  observe  a five-minute  motion  picture  sequence  and  then  describe  what  he  had 
seen;  or  to  orient  himsell  by  use  ol  visual  and  auditory  cues  which  were  in  con- 
flicL 

> Tests  ol  Intelligence  and  Judgment.  Several  tests  were  used  to  provide  measures 
ol  verbal,  numerical,  memory,  and  reasoning  ability.  Candidates  might  be  required 
to  write  twenty-minute  essays:  to  solve  mental  and  written  aiilhmelic  problems:  to 
listen  as  a passage  was  read  and  later  recall  key  words  Irom  it:  or  to  loo'i  at  a 
motion  picture  or  a drawing  of  a complex  mechanical  device  and  then  write  a de- 
scription of  how  the  apparatus  worked.  No  objective  type  vocabulary  or  reading 
comprehension  tests  were  used.  The  Test  ol  Practical  Judgment  is  characteristic 
of  tests  in  this  group.  Items  in  a printed  booklet  described  problems  requiring 
practical  judgment  lor  their  solution.  Fur  example,  one  item  described  the  problem 
lacing  an  officer  who  had  to  reach  an  objective,  and  who  could  choose  one  ol  three 
possible  routes  lor  his  troops:  a direct  route  which  was  under  enemy  lire:  a longer 
route  across  a partially  damaged  bridge:  and  a route  across  a lake  on  which  there 
were  no  boats.  The  candidate  wrote  accounts  ol  what  he  would  do  in  each  situation, 
giving  reasons  for  his  choices  ol  action.  In  scoring  the  test,  no  single  choice  was 
considered  correcL  but  the  reasons  given  lor  choosing  a particular  solution  were 
studied  (or  indications  ol  planning  ability  and  good  judgment 


FIGURE  3.5-4  THIS  FIGURE  GIVES  AN  OVERVIEW  OF  PILOT  SELECTION  TESTS  USEO  BY  THE  GERMANS  DURING 
WORLD  WAR  II  (FITTS,  194S,  PP,  154-155) 
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training  and  combat  were  located.  The  statis- 
tical techniques  which  a psychologist  in  the 
United  States  would  consider  essential  for  the 
analysis  of  group  data  apparently  were  unknown 
to  the  majority  of  German  psychologists.  . . 

"The  lasting  scientific  contribution  of  German 
aviation  psychologists  appears  at  present  to 
be  quite  small.  The  value  of  their  character- 
ological  examination  techniques,  and  the  sound- 
ness of  their  theories  concerning  the  total 
personality  will  be  determir.,-d  only  through 
subsequent  research.  In  summary,  it  can  be 
said  that  psychology,  insofar  as  it  continued 
to  be  a liberal  science  of  the  individual,  did 
not  prosper  under  the  social  philosophy  and 
political  control  which  existed  in  Germany 
prior  to,  and  during  World  War  II." 

(pp. 159-160). 


3.5.3  The  World  War  II  Japanese  Program  - A 
review  of  the  Japanese  pilot  selection  program  in 
World  War  II  is  contained  in  an  article  by  Geldard 


and  Harris  (1946).  This  brief  review  is  based  upon 
that  article. 

The  Japanese  had  interest  in  aviation  psychol 
ogy  as  early  as  1918,  and  this  interest  was  mani- 
fested in  the  establishment  of  their  Army  Air  Force 
psychological  research  laboratory  in  1935  (Geldard 
and  Harris,  1946).  Numerous  tests,  both  written 
and  psychomotor,  were  developed  in  the  laboratory 
and  some  unusual  test  ideas  also  emerged.  For 
example,  an  orientation  test  was  tried  in  which  the 
subject  was  shackled  to  a large  hoop  and  required 
to  perform  various  identification  tasks  while  being 
rotated. 
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Japanese  pilot  candidates  were  tested  at  the 
Aviation  Fitness  Testing  Unit  which  was  a central 
testing  facility.  Like  the  United  States,  psycho- 
logical  testing  was  organized  under  the  medical 
department.  The  testing  program  included  group 
tests  of  intelligence,  numerical  ability  and  rhythm 
perception;  and  individual  tests  of  psvchomotor  and 
verbal  ability.  The  verbal  test  was  actually  an 
interview  which  used  a biographical  data  blank  as  a 
starting  point.  Figure  3.5.5  presents  an  overview 
of  the  tests  used  by  the  Japanese  Army  Air  Forces 


Unfortunately,  the  validity  data  for  the 
Japanese  Army  Air  Forces  tests  were  destroyed. 
Interviews  with  Japanese  psychologists  indicated 
that  the  validity  coefficients  ranged  from  .30  to 
.65  (Geldard  and  Harris,  1946).  The  criterion 
used  was  rank  order  in  the  class  at  the  conclusion 
of  training.  Those  interviewed  (Geldard  and  Harris, 
1946)  indicated  that  the  criterion  was  too  unreli- 
able for  the  coefficients  to  be  meaningful. 

The  Japanese  Naval  Air  Force  also  conducted 


during  World  War  II . 

/ 

( 

Inlellittnct  Tesis 

Tkese  tests  esisted  in  live  loims,  differini  in  their  decree  of  difficulty.  All  con- 
Uined  the  lollotvini  six  parts,  however: 

a.  Directions.  Simple  instructions  were  to  be  followed,  e.g,,  “You  will  see  circles 
from  1 lo  S arranged  in  a circular  pattern  like  a plum  blossom.  When  I say  'Begin’ 
draw  a straight  line  connecting  Circle  1 and  Circle  3,  and  a straight  line  connect- 
ing Circle  5 and  Circle  2."  Ten  different  sets  of  instructions  comprised  this 
section. 

b.  Digit  Comparison.  Two  columns  of  four-digit  numbers  were  given;  the  pairs  were 
to  be  judged  as  “same"  or  “different",  thus: 

7935  7935  (same) 

4013  4913  (different) 

This  was  a test  of  clerical  speed  and  accuracy  involving  50  pairs  of  numbers,  lour 
lo  nine  digits  in  length, 

c.  Hidden  Figures.  Simple  geometric  forms,  “hidden”  in  a much  more  complex  one, 
were  to  be  lound  and  identified  by  appropriate  numbering.  This  was  essentially  a 
paper  lormboard.  There  were  15  forms  to  be  located. 

d.  Substitution.  Digits  were  to  be  substituted  for  geometrical  forms  in  a long  setiuence 
of  the  falter,  eight  series  of  40  symbols  each  being  presented. 

e.  Reasoning.  A sequence  of  logically  related  digits  was  to  be  completed,  e.g,  1, 2,  . 
4,  8,  -,  32.  Twenty  problems  of  this  type  were  included  in  this  “inductive  reason- 
ing" test. 

f.  Arithmetic  Reas  ining,  A set  of  10  problems,  4 multiple  choice  answers  being  sup- 
plied in  each,  v ere  to  be  solved.  Certain  of  the  items  made  rather  less  demand  on 
reasoning  processes  than  upon  possession  ot  common  bits  of  information. 

Scoring.  Total  scores  on  the  intelligence  lest  would  range  between  -16  and  +21  after 
appropriate  conversion  of  all  six  parts. 

Psychomotor  Tests 
Motor  Coordination  Test  “A” 

This  test  was  essentially  a “mirror  drawing-eye-hand-loot  coordination  test."  A 
movable  plate,  carrying  a record  form  with  an  irregular  line  path,  could  be  moved  to 
and  fro  by  appropriate  motions  of  a "rudder";  an  ink-writing  stylus,  controlled  by  a 
“stick”,  could  trace  left-right  deviations  of  the  path  . Looking  in  the  mirror,  and  with 
hands  and  feet  screened,  the  line  was  to  be  traced  as  accurately  and  rapidly  as  possi- 
ble. “This  is  a test  of  adaptability,  embarrassment,  and  judgment.”  A tracking  of  the 
combined  responses  of  hand  and  foot  could  now  be  compared  with  the  true  path. 
Accuracy  was  not  objectively  scored  but  five  “standard  patterns”  served  as  sources 
of  comparison.  Thus  the  scoring  procedure  used  in  handwriting  and  similar  scales 
was  used.  It  admittedly  having  a large  subjective  element,  but  judged  to  be  sufficient- 
ly accurate  tor  the  purpose  at  hand. 


psychological  testing  in  conjunction  with  the 
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Motor  Coordination  Test  “B" 

This  test  involved  a horizontal  drum,  viewed  through  a mirror,  the  drum,  rotating 
toward  the  subject  at  a rate  of  one  revolution  per  minute,  A paper  on  the  drum  had  two 
irregular  but  parallel  lines  on  it  which  were  to  be  followed  with  ink-writing  styli 
actuated  by  slick  and  rudder  controls.  Paper  speed  past  the  recording  points  was  I cm 
/sec.  Lateral  adjustments  of  the  “stick"  permitted  tracing  one  ol  the  lines;  the  rud- 
der" traced  the  other.  A practice  period  involving  two  revolutions  of  the  drum  was  al- 
lowed, then  a single  scored  trial  ol  one  revolution  (60  cm.  record)  was  given.  Any 
obvious  clumsiness  in  manipulation  led  to  a repetition  ot  the  test.  If  the  clumsiness 
remained,  the  fact  was  noted  on  the  record  sheet  under  "Remarks.”  Any  "remark" 
had  an  important  bearing  on  the  final  decision. 

Caclulations  Test  (“Test  ol  Working  Ability"). 

The  “pattern"  of  performance,  as  judged  by  the  work  profile,  was  compared  with 
those  lor  “normal”,  “subnormal",  “middle",  “unstable",  and  “pathological"  types. 
The  average  total  number  ol  digit  pairs  completed  also  contributed  to  a complex  score, 
partially  determined  also  by  the  amount  of  variability  from  row  to  row  and  the  general 
work  decrement  An  “introspective  report",  consisting  ol  checked  answers  lo  24 
questions,  inquired  into  feelings  and  atlitudes  prior  to,  during,  and  after  the  examina- 
tion. This  lest  was  regarded  by  its  users  in  be  a “diapiostic  test  of  character"  and, 
as  such,  was  thus  largely  clinical  in  spirit  ui.u  Interpretation.  Successive  pairs  of 
digits  arranged  in  long  rows  were  lo  be  added  and  the  Integer  in  the  unit  column  ol 
each  sum  written  down.  The  examinee  worked  continuously  lor  one  minute  when  he 
was  stopped  and  directed  to  the  next  row  ol  digits.  Accuracy  of  the  result  was  less 
important  than  total  “mental  work"  pertormed  which,  in  turn,  was  regarded  as  less 
significant  than  the  total  “pallern  ol  response"  throughout  the  entire  lest.  Fifteen 
rows  were  lo  be  completed,  a live  minute  rest  period  was  interposed,  then  10  more 
rows  were  worked  in  the  same  fashion. 

Auditory  Perception  ol  Rhythm  Test. 

This  test  was  given  in  two  parts.  In  the  lirst,  lour  groupings  of  sounds;  A = — ; 

B = ; C = ; D = were  presented  in  mixed  order.  The  examinee  simply 

identified  each  and  wrote  down  the  appropriate  symbol:  A,  B,  C,  or  D.  The  sounds 
were  reproduced  from  a gramophone  record  through  a loud  speaker:  individual  ear 
phones  were  not  used.  In  the  second  pari  ol  the  test  20  groups  ol  three  word  sounds 
each  were  presented,  the  task  being  to  indicate  whether  one  sound,  different  from 
the  remaining  two,  came  lirst,  second,  or  third  in  the  sequence. 

The  test  was  designated  by  its  users  the  “communications"  or  “code"  lest 
and  was  originally  devised  with  radio  communications  in  mrnd.  It  was  used  in  the 
selection  ol  all  aircrew  and  certain  ground  personnel,  however. 


FIGURE  3.5-5  THIS  FIGURE  GIVES  AN  OVERVIEW  OF  SELECTION  TESTS  USEO  BY  THE  JAPANESE  ARMY  AIR 
FORCE  DURING  WORLD  WAR  II  (GELDARD  AND  HARRIS,  1946,  PP.  207-208) 


MDC  E1634  • 29  APRIL  1977 


3-85 


'•4 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


AffCOOMMELL  OOtlGLAS 


medical  examination.  The  types  of  tests  used  were 
similar  to  those  used  by  the  Japanese  Army  Air 
Forces,  but  there  was  apparently  greater  emphasis 
placed  on  the  psychomotor  tests  in  the  Navy  group. 
Figure  3.5-6  presents  an  overview  of  the  factors  used 
by  the  Japanese  Naval  Air  Force  during  World  War  II. 

There  has  been  great  interest  in  the  kamikaze 
pilot  over  the  years.  From  the  research  of  Geldard 
and  Harris  (1946),  it  appears  that  very  little  selec- 
tion per  se  was  used  for  this  group.  A very  inter- 
esting quote  from  Geldard  and  Harris  serves  to  point 
out  many  flaWs  in  such  a system  and  to  describe  this 
unique  military  phenomenon. 


"...  kamikaze  pilots  were  not  selected,  in 
the  usual  sense,  at  all.  The  army  policy  was 
to  force  applications  by  creating  a 'spiritual 

Inlellitence  Test. 

This  test  had  twelve  parts  as  follows:  (1 ) Mazes;  (2)  Cube  countint;  (3)  Pattern 
test;  (4)  Symbol-di|it  substitution;  (S)  Accuracy  with  difits  (same-different); 

(6)  Simple  addition;  (7)  Inductive  reasonint  (ceometrical  forms);  (8)  Inductive 
reasonini  (di|lt  series);  (9)  Cancellation  of  leometrical  forms;  (10)  Fi|ure 
completion  after  rotation  of  tifure;  (11)  Identification  of  relative  parts  of 
distorted  fifures;  (12)  Followini  directions. 

Kiaeoelin-tlchida  Mental  Addition  Test. 

This  test  was,  in  all  particulars,  ktentical  with  the  “Calculations  Test"  used 
by  the  JAAF  and  described  in  Fifure  3.5-5. 

“Motion  Conbol"  Test. 

In  this  apparatus  an  artificial  horizon,  viewed  throufh  a window^was  made  to 
oscillate  erratically  by  a motor  driven  cam.  A “stick”,  free  to  move  laterally, 
was  joined  by  a pulley  system  to  the  cam  mechanism  and  appropriate  ri|ht-lefl 
movements  would  correct  for  the  tippinc  of  the  horizon.  The  time  in  which  the 
horizon  was  held  level,  in  a continuous  pursuit  performance,  was  measured 
with  an  electric  chronometer, 

"Three  Pointer”  Test 

This  was  also  a pursuit  test.  Three  differently  colored  pointers,  movini  about 
a cofflitton  aiis,  were  rerguired  to  be  kept  in  coincidence.  A black  pointer, 
driven  by  an  electric  motor,  made  simple  reciprocatini  pendular  motions. 

A red  pointer,  controlled  by  a “rudder”,  and  a white  one,  moved  by  a “stick”, 
were  to  follow  the  black  painter.  The  time  in  which  all  three  were  in  coinci- 
dence was  measured  by  an  electric  timer. 

“Judiment  Coordination”  Test. 

A motor-driven  turntable,  disposed  horizontally,  had  painted  on  its  periphery 
a series  of  anows,  some  pointini  cenbipetally,  others  centrifuplly.  Two 


A r#o  Af 

atmosnhare,'  offering  unusual  rewarris,  and  by 
indicating  by  rational  argument  that  military 
necessity  required  a large  number  of  appli- 
cants. At  the  beginning  applicants  were 
prompted  by  the  highest  patriotic  motives; 
later  a poor  type  of  'show-off  applied. 

The  actual  decision  to  become  a kamikaze 
pilot  was  made  in  a kind  of  'father  confessor' 
situation,  held  privately  between  the  appli- 
cant and  his  conmanding  officer.  Upon  being 
'converted'  the  candidate  was  given  very 
special  privileges:  (1)  he  could  go  on 

leave  irsnediately  (a  very  rare  reward  in  the 
Japanese  Army);  (2)  he  was  given  special 
foods  - anything  he  wished;  (3)  he  was  en- 
couraged to  indulge  himself  sexually;  (4)  he 
could,  within  limits,  choose  the  time  of  his 
death,  i.e.,  when  his  mission  was  to  take 
place.  Completely  untrained  pilots  were 
never  used,  contrary  to  rumor.  Some  had  had 
as  many  as  3000  flying  hours.  Late  in  the 
war  a few  had  had  as  little  as  20  hours  of 
training,  but  this  was  very  exceptional  and 
at  a time  when  the  fully  trained  pilot,  ready 
for  combat,  might  have  had  less  than  100 
hours  total  flying  time.  9_io3i 


noodles,  actuated  by  a sin(le  wheel  which  could  be  turned  clockwise  or 
counterclockwise,  were  suspended  over  the  near  ed(e  of  the  disc.  Movements 
of  the  wheel  caused  the  needles  to  move  to  the  rifht  or  left  without  chan(in| 
their  spacin^  The  task  was  to  make  the  needle  points  pass  always  behind 
the  arrows  and  without  touchini  the  ed|e  of  the  disc.  Errors  were  recorded 
by  an  electric  counter. 

“Selective  Reaction”  Test. 


On  a slopin(  panel  there  appeared,  throufh  a window,  a row  of  si«  arrows.  Each 
arrow  could  point  in  any  of  eifht  directions.  The  three  on  the  rifht,  tofether 
with  a “fuide”  arrow  which  appeared  in  a smaller  window  above  them,  were  to 
be  reacted  to  with  the  rifht  hand.  Whenever  any  two  of  the  three  had  the  same 
indicated  direction  as  the  fuide  arrow  a key  was  to  be  pressed.  The  same 
arranfement  obtained  lor  the  telt  side  of  the  apparatus,  a second  key  beinf 
supplied  for  the  left  hand.  All  arrows  chanfed  direction  once  each  second. 
Errors  were  counted  electrically. 

“Memory  of  Speed"  Test. 

An  endless  belt,  60  cm,  wide,  havinf  alternate  black  and  white  stripes 
painted  on  it,  was  driven  at  a constant  and  predetermined  rate.  The  evaminee 
was  to  view  the  movinf  field  and  “memorize”  it.  The  field  speed  was  then 
chanfed  and  the  subject  was  required  to  adjust  it,  by  turninf  a control  knob, 
until  the  remembered  speed  was  reestablished.  The  eilent  of  the  error  of 
settinf  was  measured  on  a calibrated  scale. 

“Fifure  Refeneration"  Test. 

A series  of  feometrical  lifures,  connected  in  a sinfle  sequence,  passed  by 
a window  in  a bos.  The  eiaminee  was  to  view  the  entire  sequence,  "inte- 
frate"  it,  then  reproduce  the  whole  fifure  by  drawinf.  This  lest,  inspired 
by  Gestalt  considerations,  also  made  its  way  into  the  USAAF  esperimental 
profram  In  motion  picture  testinf. 


FIGURE  3.5-6  THIS  FIGURE  GIVES  AN  OVERVIEW  OF  THE 
SELECTION  TESTS  USED  BY  THE  JAPANESE  NAVAL  AIR 
FORCE  DURING  WORLD  WAR  II  (GELDARD  AND 
HARRIS,  1946,  PP.  215-216) 
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"The  morale  of  special  attack  pilots  was  bad, 
on  the  average.  After  the  'feast,'  the  kami- 
kaze pilot  was  likely  to  lose  much  of  his 
fervor  and  many  made  all  kinds  of  excuses  to 
get  out  of  the  final  death  mission.  One  is 
known  to  have  burned  his  plane  on  the  night 
before  his  scheduled  takeoff.  In  general, 
the  planes  used  were  very  inferior  ones, 
naturally,  and  the  pilots  came  to  mistrust 
them.  'Good  results  cannot  come  out  of 
despair'  and  the  average  effectiveness  of 
the  special  attack  pilot  in  guiding  his  plane 
to  the  target  was  said  to  be  very  low.  The 
poor  morale  of  this  group  led  Hr.  Mochizuki, 
who  was  making  a special  study  of  this  matter 
for  Koku  Hombu,  the  Air  Headquarters,  to 
recommend  to  the  Minister  of  War  that  the 
entire  venture  be  dropped.  Humanitarian 
considerations  were  not  involved  in  this 
recommendation  - 'That  had  all  been  settled 
at  the  beginning  and  there  was  no  point  in 
raising  the  question'  - but  sheer  military 
ineffectiveness  coming  out  of  atrocious 
morale  was  the  reason  for  the  recomiendation. 
Poor  morale  was  not  an  uncommon  phenomenon  in 
the  Japanese  Army  Air  Force  and  was  traceable 
to  more  causes  than  mechanical  inefficiency 
of  the  planes."  (pp.  211-212) 


3.5.4  Summary  - Several  important  items  can 
be  gleaned  from  the  review  of  foreign  selection 
programs.  The  German  selection  program  in  World 
War  II  worked  moderately  well  but  was  dropped  early 
in  the  war.  Their  emphasis  on  the  intangible 
aspects  of  character  at  the  expense  of  aptitude  or 
skill  factors  limited  the  program.  The  Japanese 
had  a well  conceived  testing  program,  but  relied 
upon  a criterion  with  low  reliability  (class  rank 
in  a training  course). 

The  Israelis  have  a unique  testing  and  selec- 
tion program  which,  in  many  ways,  goes  beyond  other 
programs.  They  include  a ten  day  "tent  city"  test 
program,  continue  the  selection  process  through 
training,  and  have  less  stringent  educational  pre- 
requisites. Several  selection  factors  which  are 
not  assessed  in  the  U.S.  military  aviation  commun- 
ity are  evaluated  in  the  Israeli  program.  Most 
notable  are  stress  tolerance  and  the  broad  set  of 
personality  factors  tested  in  a group  performance 
envi ronment. 
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3 . 6 PILOT  INPUTS  TO  THE  DEVELOPMENT  OF  HYPOTHESES 
rONCERNlMG  THE  CHARACTERISTICS  OF  THE  ACE 

In  addition  to  technical  sources  of  information 
concerning  the  characteristics  of  combat  effective 
pilots,  both  direct  and  indirect  sources  of  pilot 
opinion  concerning  combat  effectiveness  were  inves- 
tigated. It  was  felt  that  these  pilot  opinions 
would  add  critical  insights  into  the  complex  prob- 
lem of  combat  effectiveness.  Four  approaches, 
three  direct  and  one  indirect,  were  used  to  gather 
this  information.  These  consisted  of  a review  of 
popular  literature  describing  fighter  pilots  in 
American,  German  and  Japanese  air  forces  during 
World  War  II  and  the  American  Air  Force  during  the 
Korean  War.  The  three  direct  sources  of  pilot  opin- 
ion were  derived  from  questionnaires  returned  to  us 
by  373  pilots  (and  described  in  Section  2.0).  The 
responses  to  three  items  on  that  questionnaire  con- 
stitute the  pilot  inputs  to  this  section.  The 
first  item,  "From  your  personal  experiences,  do  you 
recall  any  event  which  illustrates  the  qualities 
required  for  an  ace,"  is  an  open-ended  question,  and 
extensive  responses  were  received.  In  the  second 
item,  pilots  were  asked  to  rate  a number  of  cate- 
gories of  personal  attributes  with  respect  to  their 
importance  in  becoming  an  ace.  The  third  item  con- 
cerned flying,  perceptual  and  judgmental  skills  and 
abilities  which  would  distinguish  an  effective  from 
a non-effective  fighter  pilot.  An  analysis  of 
these  responses  provided  much  useful  information 
regarding  the  critical  personality  characteristics 
and  the  skills  necessary  to  make  up  the  combat  effec- 
tive pilot.  These  responses  also  provided  one  of  the 
bases  for  our  analysis  of  the  importance  of  the 
various  selection  factors  identified  in  the  techni- 
cal combat  literature. 

3.6.1  Pilot  Inputs  from  the  Popular  Literature- 
Hundreds  of  books  have  been  written  describing  ace 
fighter  pilots.  Unfortunately,  most  of  these  books 
and  stories  are  fictionalized  descriptions  of  a 
somewhat  larger  than  life  heroic  figure.  From  this 
literature,  only  a few  books  emerge  as  being  reasona- 
bly accurate  accounts  of  the  pilots  themselves  and 
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their  actions.  These  books  are  typically  either 
biographical,  autobiographical  or  based  on  inter- 
views with  the  pilots.  To  sample  this  literature, 
we  reviewed  14  books  directly  concerned  with 
descriptions  of  aces  from  the  U.S.,  Germany,  and 
Japan  during  World  War  II  as  well  as  material 
available  on  the  American  aces  from  Korea.  From 
this  group,  those  books  written  by  Col.  R.  F. 
Tolliver  and  T.  J.  Constable,  E.  H.  Sims, 

G.  Gurney,  and  Saburo  Saki  were  especially  useful. 
Despite  the  basic  historical  validity  of  these 
books,  the  style  of  writing  of  the  authors  tends 
to  romanticize  the  descriptions  of  the  fighter 
pilots.  Attempts  were  made  to  abstract  from 
these  books  accurate  descriptive  passages  which 
would  illustrate  the  characteristics  of  the 
greatest  ace  fighter  pilots,  although  specific 
characteristics  related  to  the  ace  fighter  pilot 
were  difficult  to  find  within  the  context  of  the 
writing.  Figure  3.6-1  illustrates  the  results 
of  this  review. 

From  Figure  3.6-1,  it  is  apparent  that  aggres- 
siveness, the  ability  to  spot  the  enemy,  the  courage 
to  attack,  and  skill  in  both  gunnery  and  handling 
the  aircraft  are  considered  important  or  at  least 
notable  characteristics  of  the  ace.  An  excellent 
overall  summary  description  of  these  characteristics 
was  found  in  G.  Gurney's  (1961)  book  Five  Down  and 
Glory, 

"Thus  we  have  the  creature,  the  ace.  He  was 
neither  always  young  nor  always  old:  age  was 
no  criterion.  Nor  did  size,  nor  height,  nor 
physical  build  matter.  He  was  not  necessarily 
an  extrovert  nor  an  introvert;  a braggart  nor 
a shy  recluse.  But  though  there  were  many 
things  the  ace  was  not,  there  were  several 
things  he  seemed  always  to  be. 

"The  ace  flew  aggressively  and  always  pressed 
his  attack.  He  was  not  necessarily  reckless 
nor  foolhardy,  but  he  was  daring  and  a fighter. 
He  loved  to  fly  and  knew  his  business  when  he 
had  the  flying  machine  strapped  on  by  the 
safety  belt.  He  was  constantly  on  the  alert 
for  the  enemy  and  his  experienced  eyes  were 
able  to  catch  that  flicker  of  motion,  that 
flashing  speck  on  the  horizon,  that  almost 
unseen  movement  that  was  sometimes  the  only 
indication  that  an  enemy  was  sharing  the  same 
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RAOUL  LUFBERY 
07  KILLS,  WW  I, 
USA) 

EDWARD  RICKEN- 

BACKER 

(26  KILLS,  WW  I, 

USA) 

FRANK  LUKE 
as  KILLS,  WW  I, 
USA) 


RICHARD  I.  BONG 
(40  KILLS,  WW  II, 
USA) 


THOMAS  B. 
MCGUIRE 
(38  KILLS,  WW  II, 
USA) 


GERALD  R. 
JOHNSON 
(22  KILLS,  WW  II, 
USA) 


FRANCIS  S. 
GABRESKI 
(34,5  KILLS,  WW  II 
KOREA,  USA) 


JOSEPH 

MCCONNELL  JR. 
as  KILLS,  KOREA, 
USA) 


ERICH  HARTMANN 
(351  KILLS,  WW  II, 
GERMANY) 


“A  PILOT  WHOSE  AHACK  WAS  UKE  LIGHTNING, 
WHOSE  MARKSMANSHIP  WAS  UNCANNY  AND  WHOSE 
NERVE  WAS  NEVER  SHAKEN,”  (GURNEY,  1861,  p.  IS) 

RICKEN6ACKER  HAD  PATIENCE  ACQUIRED  FROM 
HIS  RACING-CAR  DAYS.  HE  WAS  DARING  AND 
FEARLESS,  BUT  NEVER  RECKLESS.  (GURNEY, 

1861,  p.  31) 

FRANK  WAS  A QUIET  BOY  FROM  THE  FRONTIER 
COUNTRY,  A COLLEGE  GRADUATE  AND  A 
CITIZEN-SOLDIER,  WHO  LOVED  TO  FLY  AND 
LOVED  TD  FIGHT.  HE  DIDN’T  CARE  MUCH  FOR 
THE  REGIMENTATIDN  OF  MILITARY  LIFE  AND 
MORE  OFTEN  THAN  NOT  HE  WOULD  WANDER  FROM 
A FORMATION  TO  SEARCH  OUT  THE  ENEMY  ALONE. 
(GURNEY,  1861,  p.  28) 

ALTHOUGH  MORE  OR  LESS  AN  INTROVERT  ON 
THE  GROUND,  HE  WAS  THE  EXACT  OPPOSITE 
IN  THE  AIR.  ALWAYS  EAGER  FOR  ACTION,  HE 
TOOK  HIS  P-38  INTO  ANY  ENEMY  FORMATION  HE 
COULD  FIND  REGARDLESS  OF  THE  ODDS.  WHEN 
HIS  FELLOW  PILOTS  WERE  IN  TROUBLE,  BONG 
SPED  TO  THE  RESUCE.  (HESS,  1868,  p.  28) 

“ON  INDIVIDUAL  COMBAT  TACTICS,  AGGRESSIVE- 
NESS IS  THE  KEYNOTE  OF  SUCCESS.  A FIGHTER 
PILOT  MUST  BE  AGGRESSIVE.  THE  ENEMY  ON  THE 
DEFENSIVE  GIVES  YOU  THE  ADVANTAGE,  AS  HE 
.IS  TRYING  TO  EVADE  YOU,  AND  NOT  TO  SHOOT 
YOU  DOWN.”  (GURNEY,  1861,  p.  IDS) 

“DURING  MY  EXPERIENCES  IN  OPERATING  AGAINST 
THE  JAPANESE  AIR  FORCE  THERE  HAVE  BEEN 
EVIDENT  CERTAIN  CHARACTERISTICS  AND  TRAITS 
PECULIAR  TO  THE  JAPANESE  AS  AIRMEN.  A 
KNOWLEDGE  AND  AN  UNDERSTANDING  OF  THESE 
CHARACTERISTICS  IS  NECESSARY  IN  ORDER  TO 
EFFECTIVELY  COMBAT  THE  JAP...IN  ORDER  TO 
EFFECTIVELY  AHACK  THE  JAP,  YOU  MUST  SEE 
HIM  FIRST.”  (GURNEY,  1861,  p.  108) 

HB  DAYS  WITH  THE  POLES  DIDN’T  RESULT  IN  ANY 
VICTORIES,  BUT  FROM  THEM  HE  DIO  GAIN  A DETER- 
MINATION AND  AGGRESSIVENESS  THAT  WAS  TO 
MAKE  HIM  ONE  OF  THE  GREAT  FIGHTER  PILOTS 
OF  THE  WAR.  FROM  THESE  MEN  HE  ALSO  LEARNED 
THE  TACTIC  OF  CLOSING  WITH  THE  ENEMY  TO  THE 
POINT  THAT  YOU  JUST  COULONT  MISS.  (HESS,  1868, 

p.28) 

“YOU  HAVE  TO  GO  LOOKING  FOR  THEM.  SOMETIMES 
EVEN  THB  DOESN’T  HELP.  I KNOW  OF  PILOTS  WHO 
HAVE  FLOWN  100  MISSIONS  AND  HAVEN’T  BRUSHED 
WITH  THE  MIGs  ONCE.”  (GURNEY,  1861,  p.  205) 


..JIS  WELL  AS  BY  INSTINCT  AND  TRAINING,  A FIGHTER. 
HIS  PHYSICAL  AND  MENTAL  RESILIENCE  WERE  SUCH 
THAT  HE  ENDURED  WITHOUT  FATIGUE  THE  CONSTANT 
GRIND  OF  AERIAL  COMBAT  FROM  THE  FALL  OF  1842 
UNTIL  THE  END  OF  MAY  1845...HARTMANN’S  SUCCESS 
WAS  DUE  TO  THE  WAY  HE  DROVE  HOME  HB  AnACKS. 
THEY  WERE  POINT-BLANK,  LIKE  THE  MAN.  (TOLIVER 
AND  CONSTABLE,  1870,  p.  Ill) 


GERHARD  BARKHORN 
(301  KILLS,  WW  II, 
GERMANY) 


“HE  B MY  CHOICE  OF  ALL  THE  SECOND  WORLD  WAR 
FIGHTER  PILOTS.  STEADY,  RELIABLE,  A GOOD 
LEADER,  HE  NEVER  HADE  A VICTORY  CLAIM  THAT 
WASN'T  CONFIRMED.”  (TOLIVER  AND  CONSTABLE, 
1870,  p.  87) 


GUENTHER  RALL 
(275  KILLS,  WW  II, 
GERMANY) 


A MAN  OF  SURPASSING  WILL  POWER  AND  COURAGE.. . . 
HE  WAS  PERHAPS  THE  KEENEST  COMPETITOR 
AMONG  ALL  THE  TOP4CORING  GERMAN  PILOTS 
DURING  THE  WAR.  (TOLIVER  AND  CONSTABLE, 

1870,  p.  88) 


WERNER  MOELOERS  “WERNER  MOELDERS  WAS  A VERY  WELL-EDUCATED 
ai5  KILLS,  WW  II,  AND  A HIGHLY  INTELLIGENT  MAN  WITH  AN  EXCEP- 
GERMANY)  TIONALLY  GOOD  CHARACTER.  HB  CHARACTER  WAS 

SUCH  THAT  IT  GUARANTEED  EVERYTHING  ELSE 
ABOUT  HMI.  HE  HAD  A DIRECT  LINE  OF  THOUGHT 
NAS  BRILLIANTLY  ANALYTICAL,  AND  HE  NAS 
ESPECIALLY  A MAN  WITH  GOOD  LEADERSHIP.” 
(CONSTABLE  AND  TOLIVER,  1868,  p.  65) 


HANS-JOACHIM 
MARSEILLE 
aS8  KILLS,  WW  II, 
GERIWNY) 


NO  ONE  WHO  SAW  HIM  SHOOT  IN  THE  AIR  WILL 
EVER  FORGET  HIS  DEADLY  PRECISION.  MAR- 
SEILLE WAS  MUCH  MORE,  HOWEVER,  THAN  JUST 
A SUPERLATIVE  MARKSMAN.  SINCE  HB  SHAKY 
BEGINNING  AS  A CADET  PILOT,  HE  HAD  DEVEL- 
OPED AN  AEROBATIC  ABILITY  SO  PRONOUNCED 
THAT  HE  COULD  THRILL  EVEN  VETERAN  GERMAN 
ACES  WITH  HIS  FLYING.  MARSEILLE’S  PORTFOLIO 
OF  TALENTS  ALSO  INCLUDED  EAGLE  EYESIGHT, 
FEARLESSNESS,  AND  AN  AGGRESSIVE  SPIRIT  IN 
THE  AIR  THAT  FREQUENTLY  UNNERVED  HIS  FOES. 
TO  SPEAK  OF  AN  “AGGRESSIVE  SPIRIT"  MAY  SEEM 
LIKE  AN  ABSTRACTION.  COMBAT  PILOTS  KNOW 
OTHERWISE.  (CONSTABLE  AND  TOLIVER,  1868,  pp. 
102-103) 


ALEXANDER 
POKRYSHKIN 
(58  KILLS,  WW  II, 
RUSSIA) 


THE  UNDAUNTED  POKRYSHKIN  SOON  PROVED 
HIMSELF  TO  BE  MORE  THAN  JUST  AN  UPSTART 
MECHANIC.  HB  FINE  PILOTING  SKILL  WAS 
UNDENIABLE,  AND  HIS  DETAILED  KNOWLEDGE 
OF  AIRCRAFT  CONSTRUCTION  EXCEEDED  THAT 
OF  HIS  FELLOWS...WROTE  THE  ELATED  POKRYSH- 
KIH-.  “SUCCESS  DEPENDS  ON  FIRING  FROM  CLOSE 
RANGE.”  TOLIVER  AND  CONSTABLE.  1870,  pp. 
125-1261 


HIROYOSHI 
NISHIZAWA 
a04  KILLS,  WW  II, 
JAPAN) 


EVEN  HIS  EYESIGHT  WAS  UNUSUAL.  WHERE  WE 
COULD  SEE  ONLY  SKY,  NBHIZAWA,  WITH  ALMOST 
SUPERNATURAL  VBION,  COULD  CATCH  THE  SPECKS 
OF  ENEMY  PLANES  STILL  INVBIBLE  TO  US.  NEVER 
IN  HIS  LONG  AND  BRILLIANT  CAREER  AS  A WARRIOR 
OF  THE  SKIES  WAS  THB  MAN  CAUGHT  UNAWARE  BY 
THE  ENEMY...HE  LIVED  AND  BREATHED  ONLY  TO  FLY. 
AND  HE  FLEW  FOR  TWO  THINGS,  THE  JOY  WHICH 
COMES  WITH  THE  OWNERSHIP  OF  THAT  STRANGE  AND 
WDNDERFUL  WORLD  IN  THE  SKY,  AND  TO  FIGHT.  (SAKI, 
1857,  p.  84) 


NOTE:  QUOTATION  MARKS  INDICATE  EITHER  THE  ACE’S  OWN  OPINION  OR 
THE  OPINION  OF  A CONTEMPORARY  REGARDING  THE  ACE.  OTHER  DESCRIP- 
TIONS WERE  TAKEN  DIRECTLY  FROM  THE  INDICATED  REFERENCES. 
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sky.  In  some  cases  aces  have  been  able  to  run 
up  an  impressive  number  of  victories  because 
of  their  exceptional  shooting  abilities,  but 
while  this  ability  often  made  a difference  in 
final  totals,  it  seldom,  alone,  made  a flyer 
an  ace.  The  ace  understood  his  business, 
learned  from  his  own  experience  and  from  that 
of  others,  carefully  employing  those  tactics 
which  put  to  greatest  advantage  his  fighting 
vehicle.  With  this  combination  of  fighting 
attributes  the  ace  seized  the  advantage  to 
sweep  the  enemy  before  him."  (p.  206) 

The  review  of  popular  literature  provided  a 
general  background  and  some  insights  into  what  goes 
into  making  an  ace.  The  popular  literature  is, 
however,  a secondary  source  of  these  descriptions, 
written  to  v artain  rather  than  analyze  the  pro- 
file of  an  ace.  Alternative  information  sources 
were  therefore  developed. 

3.6.2  Characteristics  and  Attributes  of  the 
Ace  Fighter  Pilot  - Inputs  from  100  Aces  - Another 
source  of  evidence  concerning  the  characteristics 
and  attributes  of  the  combat  effective  fighter  pilot 
can  be  developed  by  asking  what  ace  fighter  pilots 
think  about  this  issue.  As  part  of  our  question- 
naire effort,  we  asked  a large  number  of  fighter 
pilots  the  following  question,  "From  your  personal 
experience,  do  you  recall  any  event  which  illus- 
trates the  qualities  required  of  an  ace?"  The 
pilots'  responses  are  most  interesting  and  are  pre- 
sented in  Section  3. 6. 2. 2.  In  order  to.  draw  a com- 
posite profile  of  the  combat  effective  pilot  from 
the  response  of  aces,  we  selected  the  first  100  ace 
fighter  respondents'  answers  and  subjected  them  to 
an  analysis. 

3.6.2. 1 Analysis  of  Ace  Pilot  Written 
Responses  - One  of  the  authors  examined  each  of  the 
first  100  substantive  ace  pilots'  written  responses 
and  tabulated  descriptive  words  and  phrases,  such 
as  aggressiveness,  cool  head,  etc.  In  all,  he 
found  some  140  different  descriptor  phrases  with, 
of  course,  many  descriptors  repeated  often  (e.g., 
aggressiveness  was  the  most  common  descriptor  word 
and  appeared  explicitly  in  no  less  than  20  pilot 
responses).  Rough  categories  were  established  from 
the  140  descriptive  words,  and  the  results  are  shown 


in  Figure  3.6-1.  In  this  figure,  some  30  major 
categories  are  identified.  Various  descriptive  words 
which  seemed  to  fit  in  them  are  shown  in  smaller 
type  face  below  each  major  descriptor  word.  This 
sort  of  analysis  is  admittedly  crude;  language  by 
its  very  nature  is  imprecise.  Additionally,  the 
pilots  were  giving  us  spontaneous  responses  and, 
in  some  cases,  illustrations  of  combat  behavior. 
Nevertheless,  we  find  this  a fruitful  way  of  gener- 
ating working  hypotheses  which  can  later  be  sub- 
jected to  more  rigorous  scientific  examination. 

Based  on  the  descriptors  shown  in  Figure  3.6-2, 
the  fighter  pilots  feel  that  a combat  effective 
fighter  pilot  must  be  extremely  aggressive  and  have 
the  self-confidence  to  search  out  opportunities  to 
engage  the  enemy  and  fight  him  although  outnumbered 

and  forced  to  take  risks.  He  must  have  adequate 
flying  ability  and  aerial  gunnery  skills  and  be 
prepared  to  exploit  the  air  battle  with  an  under- 
standing of  his  aircraft  and  its  total  performance 
capability,  as  well  as  an  understanding  of  the 
enemy’s  aircraft  and  tactics.  He  and  his  wingman 
should  enter  the  battle  as  a disciplined  team. 

The  combat  effective  fighter  pilot  must 
also  have  motivation,  determination,  dedication, 
desire,  instinct  and  deliberateness  of  attack.  He 
must  be  unafraid  and  have  the  courage  to  close 
with  the  enemy  and  attack  him  at  very  close  range. 
The  ideal  fighter  pilot  should  be  in  good  health. 

He  should  have  excellent  visual  target  acquisition 
ability,  be  alert,  have  fast  reactions,  have  an 
awareness  of  the  battle  arena,  have  the  ability 
to  make  quick  decisions  and  to  act  upon  them;  he 
must  work  calmly  under  stress.  Ideally,  this  man 
would  also  be  a leader  and  highly  professional  in 
his  conduct. 

3. 6. 2. 2 What  Ace  Fighter  Pilots  Told  Us  About 
the  Qualities  Required  of  an  Ace  - As  part  of  our 
questionnaire  effort,  we  asked  a large  number  of 
fighter  pilots  the  following  question,  "From  your 
personal  experience,  do  you  recall  any  event  which 
illustrates  the  qualities  required  of  an  ace?"  The 
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AGGRESSIVE 

• BE  A EIGER 

• HARD  NOSED 

• FORCE  THE  ATTACK 

• MAINTAIN  THE  INITIATIVE 

• SPIRIT  TO  TAKE  THEM  ON 

• WILLINGNESS  TO  FIGHT 

• (HAVE  THE)  SPIRIT  OF  ATTACK 

• (AniTUOE  OF)  HAVING  THE  ENEMY  ■ CORNERED  " 

• (AITlTUOt  OF)  DESTROY, NOT  SURVIVE 


EXPLOIT 

• TAKE  ADVANTAGE  OF  THE  ENEMY'S  MISTAKES 

• TAKE  EVERY  ADVANTAGE 

• attack  WITH  ADVANTAGE 

• USE  AIRCRAFT  TO  YOUR  ADVANTAGE 

• MANEUVER  TO  TAKE  ADVANTAGE 

• FIRE  WITH  SPEED  TO  REGAIN  ALTITUDE 


UNAFRAID 

• NOT  BE  AFRAID 

• AFRAID  AS  LITTLE  AS  POSSIBLE 

• RESOLUTE 


CONFIDENCE 

• SELF  CONFIDENCE 

• (TO  BE  SUCCESSFUL) 

• CONFIDENCE  IN  FIGHT 

• CAN  DO  ANYTHING 


DISCIPLINED 

• SELF  DISCIPLINE 

• air  DISCIPLINE 

• MILITARY  DISCIPLINE 


COURAGE 

• GUTS 

• TO  ENGAGE  THE  ENEMY 

• YET  HAVE  COMMON  SENSE 

• KNOW  WHEN  TO  FIGHT  ANOTHER  DAY 


CLOSE  IN  AHACK 

• NO  DEFLECTION  SHOOTING 


, SYNERGISM  OF  LEADER  AND  WINGMAN  TEAM 
, CONFIDENCE  AND  TRUST  IN  TEAM 


MAKE  OPPORTUNITY  HAPPEN 

• LOOKED  HARO  FOR  THE  ENEMY 

• STAYED  LONGER  WITH  STRAGLERS  AND  GOT  MORE  KILLS 

• WHEN  YOU  CAN  ATTACK  - DO  IT. 


MOTIVATION 

• DRIVE 

• EAGER 

• humiliated  in  air  once  ' NEVER  AGAIN 

• anger  at  being  jumped  - KILLED  ALL  FOUR 


GOOD  HEALTH 

• STAMINA 

• PHYSICAL  COORDINATION 


FIGHT  AGAINST  ODDS 

• MOVE  AGAINST  ODDS 

• CONTINUE  AGAINST  (ADVERSITY) 

• DON'T  CONSIDER  (THE)  ODDS 

• GO  - EVEN  WHEN  OUTNUMBERED 


DETERMINATION 

• TO  SUCCEED 

• (TO)  WORK  HARDER  THAN  ANYBODY 

• SEE  YOUR  JOB  AND  DO  IT 

• (TO)  NEVER  GIVE  UP 


VISUAL  ABILITY 

• TO  SPOT  THE  ENEMY 

• WIDE  FIELD  OF  VIEW 

• GOOD  PERIPHERAL  VISION 

• SEE  HIM  BEFORE  HE  SEES  YOU 


RISK  TAKING 

• TAKE  ALL  RISKS 

• (MUST)  STICK  OUT  HIS  NECK  (AT  LEAST  ON  OCCASION) 

• (BE  A)  CALCULATED  RISK  TAKER 

• ONCE  FIGHT  STARTS  - GO  FULL  BLOWER 

• (MUST  HAVE)  WILLINGNESS  TO  TAKE  CHANCES 

• ONCE  DECIDED  - CHARGE  IN 

• ENJOY  PERSONAL  COMBAT 

• NO  CONCERN  FOR  PERSONAL  SAFETY 


ALERT 

• ALERT  THINKER 

• QUICK  AND  SMART 

• KEEN 

• GOOD  THINKING  PLANNING 


DEDICATED 

• TO  CAUSE 

• TO  ATTACK 

• TO  COUNTRY 

• TO  PURPOSE 

• TO  ACHIEVE  VICTORY 

• PATRIOTIC 

• LOYALTY  (TO  COUNTRY) 

• CONSCIENCIOUS 


FAST  REACTIONS 

• QUICK  REACTION 

• SPLIT  SECOND  DECISION 


awareness 

• OF  ALL  AIRCRAFT  IN  THE  BAHLE 


FLIGHT  ABILITY 

• CONTROL  OF  AIRCRAFT 

• KNOW  YOUR  JOB 

• EXPERIENCE,  TRAINING.  PRACTICE 


aerial  gunnery 

• BE  A DAMN  GOOD  SHOT 

• CLOSE  IN  AHACK 


be  prepared 

• KNOWLEDGE  OF  YOUR  AIRCRAFT 

• KNOWLEDGE  OF  ENEMY 

• PREPARED  FOR  FIGHT 

• (BE)  READY 

• THINK  WHERE  (ENEMY)  WILL  BE 

• LOOK  AROUND 

• NEVER  CONCENTRATE  TOO  LONG 


DESIRE 

• TO  ACHIEVE 

• TO  AHACK 

• TO  WIN 

• TO  ENGAGE  (THE  ENEMY) 

• TO  DO  EVERYTHING  TO  WIN 

• HAVE  PURPOSE  IN  MIND 

• DO  IT  BEST 

• HAVE  AMBITION 


FAST  ABILITY  TO  DECIDE  AND  ACT 
• NO  HESITATION 


STRESS 

• THINK  WELL  UNDER  STRESS 

• CONCENTRATE  UNDER  STRESS 

• HEAR  AND  THINK  IN  BATTLE 


CALMNESS 

• COOL  HEAD 

• (CALM)  UNDER  FIRE 


ITJoTINCT 

• OF  HUNTER 

• OF  KILLER 

• INBORN 

• for  COMBAT 


leadership 

• BE  A LEADER 

• DON'T  LOSE  YOUR  WINGMAN 

• LOYALTY  TO  FRIENDS 


DELIBERATE 

• ABOUT  THE  AnACK 

• CALCULATING 

• POSITIONING 


PROFESSIONAL 

• KEEP  A SENSE  OF  HUMOR  (PROPORTION’) 

• NO  GOODBYES  - NO  REGRETS 


FIGURE  3.6-2  THIS  FIGURE  SHOWS  A COMPOSITE  OF  THE  CHARACTERISTICS  AND  ATTRIBUTES  OF  THE  COMBAT 
EFFECTIVE  FIGHTER  PILOT.  THIS  COMPOSITE  WAS  ASSEMBLED  FROM  THE  WRITTEN  COMMENTS  OF  130  AMERICAN 
ACE  FIGHTER  PILOTS. 
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quotes  from  70  of  the  first  100  aces  who  responded 
to  this  question  are  presented  in  this  section. 

The  reader  is  invited  to  review  them  and  then 
reread  the  thumbnail  description  of  the  ace  that 
was  presented  in  Section  3.6.2. 1.  The  reader  not 
desiring  to  read  this  anecdotal  material  may 
proceed  to  Section  3.6.3. 


"As  stated  previously,  a good  fighter  pilot 
(and  an  ACE  is  certainly  thatl)  must  first 
possess  certain  innate  personality  and  psycho- 
logical traits  and  characteristics.  These  are 
aggressiveness,  alert  thinker,  quick  and  smart, 
hard-nosed  and  generally  a 'leader'  type  of 
person.  Given  these  attributes,  he  can  gener- 
ally be  trained  in  the  mechanical  skills  of 
piloting  an  aircraft.  Those  who  do  adapt  to 
flying  and  who  continue  to  demonstrate  the 
personality  traits  outlined  will  generally 
succeed  as  a fighter  pilot.  The  best  ones, 
of  course,  have  the  best  chances  of  going  on 
to  become  ACEs!" 

"I  was  fortunate  to  be  one  of  the  original 
members  of  the  56th  Fighter  Group.  In  all, 

40  members  of  this  Group  achieved  the  status 
of  "ACE"  during  World  War  II  (air-to-air). 

To  cite  a single  event  which  illustrates  the 
qualities  required  of  an  ace  would  be  most 
difficult.  However,  I will  try.  My  advanced 
flying  school  instructor  wound  up  in  the 
Replacement  Pilots  Pool  in  England  after  our 
group  had  been  in  combat  for  about  three 
months.  By  chance  I learned  this  and  I flew 
up  to  see  him  and  to  request  that  he  be 
assigned  to  my  squadron.  My  request  was 
granted.  From  him  I learned  that  to  get  to 
combat  he  had  broken  every  flying  regulation 
in  the  book  while  in  Training  Command.  He 
wanted  to  be  a fighter  pilot.  Well,  one  day 
on  a deep  penetration  escort  mission  I was 
leading  the  squadron,  and  my  old  instructor 
was  leading  the  third  and  fourth  elements  in 
our  16  ship  formation.  At  rendezvous  we  were 
at  26,000'  with  a thin  undercast  - no  bombers 
in  sight  - so  I dropped  through  the  undercast  - 
the  bombers  were  about  a half  mile  ahead  of 
us,  and  my  eight  jugs  (P-47s)  had  come  out 
about  a hundred  feet  directly  on  top  of  12 
ME-109S,  and  immediately  behind  me  about  1000 
yds  was  a gang  of  FW-190s.  I told  my  old 
instructor  to  bounce  the  ME-109s  under  me,  and 
I turned  to  engage  the  FW-109s  behind  us. 

Well,  Leroy  Schreiber  (my  instructor)  had  a 
hell  of  a dog  fight  down  to  12,000  feet.  Need- 
less to  say,  my  elements  had  their  hands  full 
with  not  only  a gang  of  190s,  but  also  eight 
ME-109S.  Leroy  had  not  seen  the  gaggle  behind 
us.  Finally,  I had  a call  from  Leroy  - 'Little 
Pal,  I'm  at  12,000  feet  - out  of  ammo  with  a 
109  on  my  tail.  I'll  keep  him  busy  if  you 
will  come  and  shoot  him  down.'  I said,  Leroy, 
I'm  in  a turning  dog  fight  with  a gang  up  here 
at  23,000  - I've  shot  two  down  and  must  now  try 


to  disengage  or  I'll  run  out  of  cobbs.  Leroy 
back,  'Oh,  O.K. , Little  Pal,  didn't  know  you 
were  busy  - I'll  duck  in  the  clouds  and  lose 
this  Jerry  - see  you  back  at  base.'  Leroy  had 
14  air  victories  before  he  was  KIA  on  a straf- 
ing mission  - direct  hit  by  an  88mm.  Leroy 
Schreiber  had  all  the  qualities  of  a great 
fighter  pilot:  aggressive;  great  courage; 

always  calm;  extreme  self-confidence;  and 
great  desire.  He  used  to  say,  'Boy,  if  we 
were  fighting  for  the  Germans  over  our  own 
territory,  they  would  have  to  deliver  our  iron 
crosses  in  a bushel  basket." 

"Most  of  the  fellows  I knew  who  shot  down  many 
planes  were  'hunters.'  They  worked  at  getting 
ready  to  fight,  looked  hard  for  the  enemy,  and 
when  they  found  him,  they  went  after  him.  In 
a sense  they  were  rather  deliberate  about  it, 
somewhat  dedicated  to  their  cause,  and  seemed 
to  have  a purpose  in  mind." 

"The  ability  to  simultaneously  discover,  eval- 
uate, make  a decision,  act  or  react  NOW! 

"Simply  to  seek  out,  plan  your  attack,  and 
execute  your  run  against  enemy  aircraft  or 
targets.  As  a flight  leader,  your  wing  men 
and  squadron  must  be  considered  and  informed 
of  your  intentions  of  attack  or  defense  should 
the  case  arise.  I usually  said  a quick  prayer 
for  God  to  help  me  use  all  my  ability  and 
training  to  execute  my  attack  against  the 
enemy.  1 cannot  recall  any  event  which  would 
illustrate  the  qualities  of  an  ace. 

"This  may  be  used  if  accepted  - from  personal 
experiences,  1 can  only  relate  that  as  a small 
boy,  I read  two  magazines  that  came  out  monthly. 
These  were  'The  Lone  Eagle'  and  'G-8  and  His 
Battle  Aces.'  The  authors  of  these  magazines 
made  a lasting  impression  on  my  life.  I was 
determined  to  be  an  'Ace'  or  at  least  a fighter 
pilot.  I succeeded  in  both.  Also,  I know  that 
a fighter  'Ace'  is  a special  breed  of  man. 

This  takes  nothing  away  from  the  ordinary  pilot 
or  other  men.  However,  in  our  breed  there  is 
a decided,  inbred  instinct  to  succeed,  taking 
all  risks,  asking  no  reprieve;  we  know  we  can 
do  anything,  accomplish  any  mission  and  do  it 
better. " 

"Know  your  job  beyond  question.  Know  that  you 
can  handle  any  'reasonable'  situation.  Once 
a fight  starts,  get  in  and  go  'full  blower.' 
Last,  but  not  least,  be  able  to  recognize  when 
you  have  reached  the  point  at  which  you  should 
'get  the  h — out  of  here'  and  live  to  fight 
another  day." 

"Fast  reaction  (stay  alive)  flying  wing  in 
P-51A  - no  radio.  First  indication  was  FW-190 
and  tracers  passing  cockpit.  Split-S'ed  at 
impossibly  low  altitude  and  escaped!  Visual 
and  mental  acuity  - usually  first  to  spot 
enemy.  Make  equipment  operate  at  maximum;  it 
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will  do  things  they  don't  tell  you  about  if 
the  situation  demands." 

"For  years  people  have  asked  what  makes  an  Ace. 
Some  special  mental  and  physical  attributes. 
Next  February  I will  be  57  years  old,  and  I 
can  say  I've  seen  many  events  illustrating  the 
qualities  required  of  an  Ace.  I've  seen  these 
qualities  in  many  who  never  flew  an  airplane  - 
executives  in  industry  - men  and  women  in 
sports  in  small  towns  and  big  cities.  These 
qualities  are  aggressiveness,  ambition  and 
desire  to  achieve,  determination  to  succeed 
and  the  impulse  to  move  in  spite  of  the  odds. 
These  qualities  exist  in  all  size,  shapes, 
sexes  and  colors  of  people.  And  in  people  of 
different  characteristics.  Some  are  somewhat 
on  the  wild  side  - others  very  quiet  and 
thougntful  - some  are  100%  dedicated  to  their 
occupation  or  the  job  on  hand.  All  are  suc- 
cessful to  a degree  but  generally  the  wild 
ones  run  into  a brick  wall  - the  good  mind 
with  a great  deal  of  thought  generally  quarter- 
backs the  above  qualities  to  success. 

"The  ability  (head),  guts  (heart)  and  the 
mechanical  ability  (hands)  to  continue  a mis- 
sion that  has  all  the  earmarks  of  disaster 
from  the  very  start.  Take  off  on  an  alert  - 
warning.  Received  at  least  20  minutes  after 
we  were  really  effective.  Climb  to  altitude 
on  a vector  that  was  wrong.  Have  peers  drop 
out  of  formation  for  various  reasons  until 
only  two  are  left  in  what  had  been  an  eight 
aircraft  scramble.  Each  of  remaining  two  air- 
craft get  three  each  and  have  five  burning  in 
sky  at  same  time.  This  takes  a dedication  of 
purpose  to  be  a Fighter  Pilot  even  if  sick, 
if  odds  bad,  and  all  other  'ifs.'  This  must 
be  found  - cannot  be  drilled  in  - recruit!" 

"Maneuver  always  to  take  advantage  of  enemy  - 
was  flight  leader  of  eight  1> -AOs  which  hit  a 
Jap  Bomber  force  (Bettys)  of  18  aircraft  with 
head  on  pass  - 12  Zeros  were  escort  - one  pass 
was  made  destroying  two  bombers  and  causing 
the  formation  to  abort  their  mission  and 
return  to  base.  First  time  Japs  had  ever 
failed  to  get  to  target. 

"With  my  wingman  I attacked  12  German  fighters 
that  were  attacking  a crippled  bomber.  The 
odds  were  never  considered  because  that  is 
what  I was  there  for.  That  was  my  function. 

"I  am  reminded  of  my  friend.  Captain  Swede 
Vejtasa,  USN  (Ret.)  who  was  dispatched  late 
as  combat  air  patrol  to  protect  the  carriers 
Enterprise  and  Hornet  from  a dive  bombing 
attack  during  World  War  II.  The  attack  had 
started  when  Swede  bored  in.  Diving  with  the 
enemy  through  fleet  anti-aircraft  fire,  he 
picked  off  seven  of  the  attackers.  His 
gunnery  was  so  precise  he  was  able  to  shift 
sights  from  one  target  to  another  before 
damage  was  apparent.  Just  a burst  'on  the 
money'  than  a new  victim." 
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"I  made  Ace  because  I was  willing  to  stick  my 
neck  out.  I always  maintained  that  only  one 
aircraft  can  shoot  at  you  in  a dog  fight  at  a 
time  - so  what  if  you  are  outnumbered?  I 
think  I was  astute  enough  watching  MlGs  in 
action  to  notice  that  they  never  made  rolling 
pullouts  or  turns  at  high  speed.  This  resulted 
in  my  being  able  to  figure  out  which  way  they 
would  pull  up  from  a dive  and  got  me  a couple 
of  kills." 

"Ability  to  evaluate  the  capabilities  of  your 
aircraft  versus  those  of  the  enemy.  In  the 
P-38  and  P-39  against  the  early  and  middle 
Zero,  I had  little  or  no  trouble  in  making 
these  evaluations  with  what  1 observed  and  in 
what  my  peers  discussed.  In  the  F-86  I had 
little  or  no  trouble  in  achieving  success 
against  other  F-86s.  In  Korea  I achieved 
some  damage  against  the  MIG-15  but  had  no 
victories.  After  one  encounter  in  which  I was 
not  successful  in  getting  a kill,  I finally 
only  realized  my  error  after  a discussion 
after  the  fact  with  another  ACE  (Royal  Baker). 

I just  didn't  realize  I had  to  approach  expos- 
ing my  tail  in  chasing  a MIG  in  a turn  to  get 
enough  lead  for  a killing  shot." 

"He  must  love  to  fly.  He  must  enjoy  personal 
combat,  as  well  as  being  conscientious  and 
patriotic.  He  must  be,  at  least  occasionally, 
a risk-taker.  He  must  know  his  equipment  and 
that  of  the  enemy.  An  example:  A friend  of 

mine,  a squadron  commander,  saw  enemy  aircraft 
starting  an  attack,  called  out  an  alert,  said 
to  drop  tanks  if  attacked,  and  for  blue  flight 
to  take  the  first  attackers.  We  lost  one 
pilot/plane  - they  lost  8 - 10.  Another 
friend,  also  my  squadron  commander  (a  differ- 
ent commander),  saw  enemy  aircraft  about  to 
attack.  He  gave  no  attack  instruction.  I 
asked  permission  to  break  off  attack.  Permis- 
sion granted.  We  got  five  aircraft  - the  rest 
of  the  squadron  didn't  fire  a shot.  Aggres- 
siveness, common  sense,  and  reasonable  know- 
ledge of  equipment  and  aerial  gunnery  are 
essential!  Seniority,  without  these  abilities, 
should  have  no^  influence  on  advancement. 

"From  the  time  I was  five  years  old,  I used  to 
watch  airplanes  till  they  faded  out  of  view. 

By  extending  my  outer  limits  of  vision,  I was 
able  to  spot  more  planes  and  always  saw  them 
before  anybody  else.  To  condense  this  sentence 
to  one  word  - concentration.  I attended  eight 
grade  schools  in  nine  years  and  came  to  recog- 
nize and  fight  the  bully  in  each  school  the 
first  day.  (I  took  my  licks.)  Condensation  - 
awareness.  I was  not  a "Golden  Boy"  athlete 
but  earned  my  respect  by  working  harder  than 
anybody.  My  parents  brought  me  up  with  faith 
in  God,  loyalty  to  Country  (but  not  blind 
loyalty),  and  a strong  desire  to  give  more 
than  I took.  Condensation  - sel f discipl ine. 
Other  than  these,  you  have  to  be  scared  enough 
to  run  faster  than  the  other  guy." 
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"(1)  The  guts  to  engage  the  enemy.  (2)  The 
ability  to  convert  any  situation  to  your  advan- 
tage. (3)  The  cool  quality  to  manage  your 
energy  and  conserve  your  ordnance  until  inside 
the  'kill  envelope.'  (4)  The  ability  to  dis- 
engage gracefully  and  fight  again  another  day." 

"Aggression;  Loners;  Drive.  Every  time  I saw 
an  enemy  aircraft  I charged  in  - after  all 
it's  a fighting  machine  - no  concern  whatso- 
ever for  personal  safety." 

"Keen,  calculating,  positioning,  using  everj 
advantage  possible.  Fire  with  enough  speed 
to  regain  position  and  capitalize  on  any  mis- 
take the  enemy  might  make  while  under  fire." 

"On  the  return  portion  of  the  first  Shuttle 
mission  into  Russia  (Axis  Sally  had  passed  us 
the  word  that  her  crowd  would  give  the.  325th 
their  full  attention  on  our  way  back  to  Italy); 
they  did  indeed  - one  of  my  flight  leaders 
had  to  contend  with  two  MEs.  He  kept  yelling 
for  help  until  I finally  told  him  to  stop  his 
pissing  and  moaning  and  after  he  finished 
with  his  problem  to  come  to  my  assistance  - 
that  I had  five  "cornered"  all  by  myself. 

There  were  daisy  chains  all  over  the  sky! 

The  exchange  settled  the  entire  group  down, 
and  we  successfully  fought  our  way  the  entire 
distance  to  home  base.  Be  calm,  be  profes- 
sional and  never  lose  your  sense  of  humor. 

If  you  must  go,  do  so  with  as  much  dignity 
and  grace  as  possible." 

"It  would  take  too  long  to  describe  in  proper 
detail.  The  essence,  in  my  belief,  is  to 
have  yourself  so  thoroughly  trained  and  ready 
you  perform  without  knowing  exactly  what  you 
did.  You  literally  fly  formation  on  the  guy 
until  you  get  him.  Had  an  ME-109  almost 
shoot  me  down  - he's  been  on  my  tail  for  hours. 
Finally  outturned  him  - got  on  his  tail  - don't 
know  how  I did  it  - shot  him  down." 

"There  must  be  a strong  desire  to  attack. 

There  is  no  room  for  hesitation." 

"In  my  first  engagement,  having  been  vectored 
to  intercept  a shadowing  Japanese  aircraft, 
three  of  my  four  guns  (50  cal)  jammed  and 
were  unclearable.  With  one  remaining  gun, 
and  intermittent  jamming  of  it,  I decided 
that  I could  not  return  to  my  ship  (Enter- 
prise, CVA  6)  without  scoring  a kill.  I 
further  decided  (with  adrenalin  running)  I 
would  have  to  chop  the  enemy  aircraft's  tail 
assembly  off  with  my  propeller  to  accomplish 
what  was  patently  required.  I proceeded  to 
maneuver  to  close  quarters  on  the  enemy's 
tail  to  do  this  all  the  while  firing  and 
clearing  the  one  remaining  gun.  Fortunately 
for  me,  at  the  very  last  moment  1 obtained 
hits  (the  rear  gunner  was  already  out  of 
action  from  my  previous  runs)  that  sent  the 
aircraft  down  - the  pilot  abandoned  his  air- 
craft, but  his  chute  did  not  open  - this  kind 
of  dedication  to  achieving  victory  (adrenalin 
or  not)  is  required  if  one  is  to  become  an  ace 
(opportunities  permitting)." 


"I  guess  aggressiveness  has  to  be  first, 
since  our  guns  only  fired  forward.  Good  eyes 
or  rather  alert  eyes  has  to  be  another.  The 
ability  to  think  and  concentrate  when,  in  any 
second,  you  could  be  shot  down  has  to  be  pre- 
sent as  a basic  characteristic  of  a fighter 
pilot.  He  has  to  know  he  can  fly  the  air- 
craft better  than  his  adversary  or  even  his 
mates  - this  gives  him  the  confidence  he 
needs  to  perform  effectively." 

"The  good  fighter  pilot  must  be  alert,  eager, 
aggressive,  yet  calm  during  combat.  His 
philosophy  is,  'There  are  no  goodbyes,  and 
there  are  no  regrets."' 

"Most  aces  are  there  because  of  circumstances, 
geographical  or  time/phase.  These  are  the 
ones  who  have  not  lost  wingmen.  I personally 
lost  none.  High  kill  aces  generally  are  more 
extrovert  and  aggressive,  but  also  have  lost 
wingmen.  is  the  trade-off  worth  it?  People 
(USAF)  rarely  talk  truthfully  about  losses." 

"In  the  heat  of  battle  where  you're  on  an 
enemy's  tail  and  still  be  observant  of  other 
aircraft  in  the  sky.  Once  when  I was  on  the 
tail  of  a German  aircraft  and  circling  with 
my  wingman,  I noticed  another  German  slipping 
up  on  my  wingman's  tail.  I told  my  wingman 
to  keep  a close  lookout  to  the  rear.  I 
finally  hit  the  aircraft  ahead  of  me,  and  it 
started  to  spin  to  the  earth.  I then  looked 
at  my  wingman's  tail  and  saw  he  was  receiving 
enemy  flak.  I was  able  to  pull  in  tighter, 
and  soon  the  enemy  broke  downward.  My  wing- 
man then  saw  the  second  aircraft  I was  hitting 
and  said,  'Where  did  you  find  this  one?'  I 
stated  he  was  right  on  your  ass." 

"Dedicated  to  country  or  service.  Aggressive, 
at  least  mentally  so.  Determined  - one  who 
finds  reasons  to  ^ something  rather  than 
reasons  not  to  do  it.  Ability  - must  have 
confidence  in  his  own  ability.  A burning 
desire  to  be  first,  to  ^e  successful , to 
have  some  sort  of  recognition  - even  to  a 
fault." 

"On  December  23,  1941,  I engaged  in  my  first 
combat  mission.  1 was  with  the  American 
Volunteer  Group,  in  Rangoon,  Burma.  We  flew 
P-40B's.  Fourteen  of  us  from  the  Third  Sgdn., 
which  had  been  sent  to  help  defend  Rangoon 
shortly  after  December  7th,  went  up  in  two 
flights  to  intercept  a force  of  52  Jap  bombers 
(twin  engine)  and  about  30  fighters  (Nates  and 
Zeros).  I had  had  no  aerial  gunnery  of  any 
kind  prior  to  this  combat,  and  when  the  flight 
I was  in  attacked  one  of  the  enemy  bomber 
formations  from  the  classic  high-side  pass,  I 
discovered  that  the  deflection  shot  was  a real 
bitch.  Consequently,  after  missing  badly  on 
a couple  of  passes  and  breaking  away  at  too 
great  a range,  I determined  to  fix  things  by 
boring  in  from  dead  astern  on  the  next  pass. 

I was  fully  aware  of  the  fact  that  this  made 
me  a much  easier  target  for  all  the  bomber 
guns,  but  at  the  same  time  knew  I should  get 
results.  I did,  by  boring  in  to  within  less 
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than  a hundred  yards  on  the  last  bomber, 
blasting  away  with  my  four  .30  cal.  wing 
guns  and  two  .50's  firing  through  the  prop. 

The  bomber  blew  up  In  my  face  just  as  I 
started  to  pull  up;  a cylinder  head  from  one 
of  his  engines  went  through  one  of  my  wings. 

My  elation  knew  no  bounds;  however,  knowing 
I'd  got  one  of  them  at  least,  no  matter  what 
happened  later,  I repeated  the  process,  and 
a few  minutes  later  another  bomber  was  going 
down  blazing.  Meanwhile,  1 was  shot  up  - a 
later  count  showed  93  holes  In  my  plane,  but 
nothing  real  serious.  I guess  the  point  is 
that  I was  willing  to  take  a much  greater 
risk  In  exchange  for  knowing  I’d  get  the 
desired  results.  Others,  of  course,  did  the  _ 
same,  while  others  refused  to  stick  their  * 
necks  out  to  that  extent.  I need  not  add 
that  the  latter  group  never  became  Aces,  nor 
did  they  gain  much  respect  from  the  others." 

"Guts  and  cool  head!  Flying  proficiency  Is 
minor  item.  Numerous  pilots  In  our  squadron 
(New  Guinea  - Fifth  Air  Force  - P39s  In  '42, 
P-38s  in  '43-'44)  performed  poorly  in  combat 
due  to  non-aggressiveness.  They  tended 
toward  snafu-itis  - this  trait  can  only  be 
described  as  'lack  of  guts.'  Many  examples 
can  be  given  by  those  of  us  who  did  perform 
our  combat  job  - flight  proficiency  does  not 
make  an  ace  - 'guts'  is  the  primary  requisite! 
No  guts  - no  victories!  After  'guts'  comes 
'cool  head,'  then  proficiency." 

"(1)  Good  physical  coordination  with  quick 
reflexes;  (2)  Keen  eyesight  with  good  perip- 
heral vision;  (3)  Aggressiveness;  (4)  Guts." 

"Aggressiveness  stems  from  the  top  - If  the 
leaders  are  not  aggressive  then  the  unit  most 
likely  will  not  perform  well.  A P-38  outfit 
that  I belonged  to  could  only  think  of  a 
Lufberry  circle  when  engagement  occurred. 

The  leaders  didn't  have  confidence  in  the 
aircraft  and  constantly  used  it  in  a manner 
to  its  disadvantage,  i.e.,  very  high  altitude 
instead  of  medium  to  low  altitude.  To  offset 
this,  I was  constantly  talking  of  more  aggres- 
siveness to  my  flight  and  squadron  members 
and  to  use  the  aircraft  to  its  best  advantage." 

"Protect  your  friends  first.  Your  victory  is 
secondary.  Captain  Pete  picked  up  a ME109  on 
his  tail  over  Gabu,  Africa.  I had  a good 
set-up  on  a FW190  off  my  left  wing.  The  109 
on  Pete  was  a long  shot  and  not  as  well  set 
up  as  the  190.  The  109  on  Pete  was  about  an 
80"  deflection.  I took  the  109  off  Pete  and 
almost  got  it  by  the  190  who  maneuvered  behind 
me.  Pete  almost  kissed  me  upon  return. 

Look  around,  look  around,  look  around!  Over 
Salerno,  Italy,  the  controller  gave  me  the 
position  and  altitude  of  a squadron  of  ME109s 
about  to  strafe  the  landing  party.  I climbed 
to  a higher  altitude  and  headed  to  the  sun 
side  of  this  reported  position.  We  were  all 
looking  down  to  see  them  first.  They,  how- 
ever, had  split,  and  we  were  surprised  by  a 
coordinated  atta,.k  from  above  just  as  we  were 


tipping  over  for  an  attack  on  the  lower 
gaggle.  We  did  not  look  around  enough. 

Result  - a couple  of  P-38s  shot  up  but  no 
losses  - enemy  lost  five." 

"We  were  flying  P-51s  on  a ground  attack 
mission  over  Germany.  My  squadron  leader 
was  shot  up  by  ground  fire.  As  he  went  down, 
on  fire,  I told  him  to  land  on  a hard  surface 
so  1 could  land  and  pick  him  up.  He  ordered 
me  to  take  the  squadron  home.  I refused.  He 
crash  landed  In  a muddy  field,  and  I landed 
In  a nearby  wheat  field  that  had  been  partly 
mowed.  As  I taxied  in  circles  waiting  for 
him  to  get  to  my  airplane,  I came  under  fire 
from  German  soldiers.  I returned  fire  with 
my  service  pistol,  setting  a truck  on  fire. 

When  he  arrived,  I threw  out  my  parachute  and 
dinghy  to  make  room  for  both  of  us  In  the 
single  cockpit.  I sat  on  his  lap  and  flew 
the  airplane  off  - only  slightly  damaging  a 
haystack  in  the  process.  On  the  way  home,  I 
overheard  a dog  fight  on  the  radio  - between 
P-51s  and  FW190s.  I tried  to  get  OF  vectors 
to  the  dog  fight  so  I could  join  in  - but 
was  refused  - so  I flew  on  back  to  base  with 
my  passenger  and  landed  safely.  I was  then 
brought  up  on  disciplinary  charges  for  dis- 
obeying direct  orders  under  enemy  fire.  I 
ended  up  with  a reprimand  and  a big  decora- 
tion. Looking  back  now,  I can't  recall  what 
went  through  my  mind  during  this  episode  - 
but  I'm  reasonably  certain  that  it  never 
occurred  to  me  at  the  time  that  I was  taking 
any  ill-advised  action  or,  for  that  matter, 
incurring  unnecessary  risk.  Nor  am  1 quali- 
fied to  describe  whatever  personal  qualities 
that  might  have  been  involved.  In  retrospect, 
however,  and  with  all  humility,  I suppose  that 
if  I were  a battle  commander  today,  I would 
hope  that  my  young  fighter  pilots  would  exhibit 
a similar  attitude  under  fire.  If  so,  I would 
discipline  the  hell  out  of  them,  decorate  them, 
and  fight  to  keep  them." 

"Desire  to  chase  and  overcome  the  enemy  some- 
times causes  you  to  ignore  either  operating 
limits  of  the  equipment  or  what  might  be  con- 
sidered prudent  restraint.  An  example  in  my 
case  - night  fighters  - pursuit  and  kill  of 
a Japanese  float  plane  at  100'  altitude  between 
cloud  layers  - no  moon  - and  70  knots  airspeed 
which  required  wheels  and  flaps  down  to  stay 
behind  him.  Aircraft  was  constantly  flying 
evasive  action  and  releasing  'window.'  I 
probably  should  have  left  him  as  he  was  harm- 
less." 

"1  led  a flight  of  eight  on  an  armed  rescue  mis 
sion  which  was  a total  failure  because  we  found 
no  'action'  and  returned  with  guns  still  taped. 
On  return  we  found  our  base  closed  by  weather 
and  set  down  at  another  fighter  base  north  of 
our  own.  After  dinner,  we  retired  to  the  club 
bar  where  we  had  a few  with  pilots  of  the  other 
group.  'How  did  your  day  go?'  I was  asked. 
'Lousy  - we  didn't  see  a thing!'  'Same  here,' 
their  leader  told  us  - 'we  saw  16  109s  once  - 
but  there  were  only  12  of  us  so  we  avoided  them 
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We  couldn't  believe  what  we  heard,  and  our 
pilots  actually  went  off  to  a corner  by  our- 
selves so  we  wouldn't  be  contaminated  by  their 
attitude.  We  felt  our  success  came  from 
association  with  people  like  'eagle'  who 
called  to  us  in  the  heat  of  one  aerial  battle 
'Hey,  you  guys  - come  on  back  behind  the  last 
box  of  bombers  - I'm  all  alone  and  I've  got 

a dozen  of  the  B s cornered!' 

That  is  the  total  of  all  qualities  required 
of  an  ace." 

"First  - desire  to  fight;  second,  ability  to 
shoot." 

"Aggressiveness  - the  willingness  and  confi- 
dence to  get  in  there  and  fight." 

"My  first  victory  resulted  from  a head-on 
pass  and  mid-air  collision  wing  to  wing 
(enemy  broke  at  last  second).  Although  I 
don't  recommend  the  technique,  it  illustrates 
a prime  requirement  - giving  first  priority 
to  destroying  the  enemy  rather  than  to  sur- 
viving the  fight  - I don't  advocate  Kamikaze 
tactics,  however." 


have  complete  and  full  confidence  that  his 
wingman  is  capable  and  on  duty.  To  get  a 
victory,  steady  tracking  and  a good  long 
burst  or  two  are  required  after  you  have  obtained 
position.  You  can  only  do  this  by  concentra- 
ting fully  on  your  target.  The  relationship 
of  a pilot  and  his  wingman,  that  provides  the 
confidence  for  the  leader  to  be  successful, 
defies  explanation.  It  is  so  tough  that  each 
can  be  called  on  to  die  for  it  and  some  do;  and 
at  other  times,  it  is  fragile.  It's  more  like 
a leader- faithful  follower  where  the  synergistic 
operation  of  two  qualified  pilots  far  exceeds 
the  expectations  of  the  two  taken  separately. 

I think  you  see  this  kind  of  thing  in  football 
where  you  have  a successful  tviosome,  one  a 
good  ball  carrier,  the  other  a good  blocker. 
Together  they  become  exceedingly  capable. 

The  general  success  of  this  in  football  is 
known  as  teamwork,  but  when  you  get  tne  right 
relationship,  you  develop  a superstar.  The 
characteristics  that  allow  such  a dependency 
bond  to  develop  must  lie  within  a successful 
fighter  pilot.  Chances  are  that  he  will  need 
it  several  times  during  his  career  if  he 
engages  a serious  enemy." 


"Be  sure  of  your  shot.  Close  in  and  conserve 
your  ammo  and  your  fuel.  Remember,  you  want 
to  be  able  to  get  home  - back  to  the  field 
or  aircraft  carrier.  If  you  run  out  of  gas, 
you've  tactically  been  shot  down;  and  there 
goes  an  aircraft  that  could  have  been  used 
tomorrow. " 

"Desire,  motivation,  aggressiveness  are  key. 
Seeing  enemy  before  he  sees  you  helps  in 
positioning  and  final  destruction  of  aircraft. 
Knowing  the  capabilities  and  limitations  of 
your  aircraft  related  to  enemy  can  never  be 
overlooked." 

"(1)  Attack  with  advantage;  (2)  defend  with 
maximum  skill.  In  all  encounters,  even  with 
very  good  fighter  pilots,  I found  that  it  did 
not  pay  to  fight  on  an  even  basis.  In  all  the 
kills  1 had,  the  enemy  pilots  were  either 
surprised  or  were  not  as  skillful  as  1 in 
air  combat  maneuvers.  I have  no  specific 
instances. " 

"The  desire  to  go  another  step  forward.  When 
escorting  bombers,  my  flight  stayed  with 
stragglers  longer  than  other  fighters.  As  a 
result,  we  saw  more  action.  When  strafing 
railroads,  we  hunted  just  a little  longer. 

It  was  not  bravery  - it  was  a desire  to  hit 
the  Geniians  one  more  blow,  and  an  ambition 
to  be  just  a little  better  than  others  in  the 
squadron. " 

"WINGMEN:  One  of  the  essential  qualities  that 
a successful  air-to-air  combat  pilot  must  have 
that  is  often  touched  upon  but  seldom  given 
its  proper  significance  is  a CONFIDENCE  AND 
TRUST  in  his  wingman.  There  is  no  way  that 
a fighter  pilot  can  go  Into  a serious  fight 
and  do  other  than  snap  shooting  if  he  doesn't 
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"The  only  way  I became  an  ace  was  my  ability 
to  hit  what  I was  shooting  at.  This  sounds 
obvious  but  I mean  - I grew  up  with  a rifle  - 
6 years  old,  and  shot  gun  - 9 years  old.  I fed 
my  family  at  age  9 until  now  with  a gun.  Until 
I started  losing  my  good  eyes  (nearsightedness), 
I could  kill  a quail  flying  with  a rifle.  An 
airplane  was  just  another  gun  to  me,  and  I had 
a cocky  confidence.  I thought  I could  out- 
shoot  any  man  who  walked,  and  I still  think  I 
could.  I have  seen  pretty  good  flyers  who 
couldn't  hit  a barge  strafing.  This  may  sound 
incredible,  but  they  could  not.  Something  that 
I knew  and  did  and  I'm  sure  a lot  of  other  guys 
did  was  get  in  close.  Six  50s  and  a 20mm  are 
like  a cutting  torch  up  close  - I mean  20  yards 
or  so  - and  when  you  touch  'em  off  at  that  dis- 
tance things  happen.  I only  had  air-to-air 
combat  on  seven  or  eight  occasions,  so  the 
only  way  1 got  what  1 did  was  1 could  hit  ’em 
and  the  angle  didn't  matter.  I'm  not  bragging, 

I 'm  trying  to  help. " 

"Never  to  concentrate  on  your  target  very  long 
so  as  to  block  out  your  side  or  even  peripheral 
vision;  rubberneck  yourself  - illustration  - 
in  October  '44  I led  a fighter  sweep  in  the 
Visayans,  and  we  were  burning  Bettys  and  other 
twin  engine  planes  parked  on  Cebu  Field.  One 
of  us  (not  me)  saw  a dust  ball  moving  across 
the  river  and  downstream  about  two  miles.  He 
did  a wingover  and  took  a closer  look.  It 
was  a Jap  fighter  strip  (Mactan),  and  Zekes 
and  Hamps  were  taking  off!  He  'Hey-Rubed'  to 
the  rest  of  us  'mohawks'  and  we  shot  down  14 
of  them  confirmed.  My  first  one  of  these 
still  had  his  wheels  down.  All  of  us  got 
back  to  the  Lexington  in  time  for  supper.  Had 
they  got  their  altitude,  it  might  have  been 
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different.  So  even  dust  can  say  something  to 
you  if  you  or  one  of  yours  just  keeps  on 
looking  around!" 

"(1)  Your  knowledge  of  your  own  weapons  sys- 
tem including  the  aircraft.  Training  and 
practice  in  operating  the  airframe  and  engine 
to  its  max.  (2)  I saved  my  life  on  several 
'enemy  at  six'  situations  by  being  physically 
able  to  overstress  and  still  fly  and  shoot. 

In  one  such  situation,  I did  an  inadvertent 
snap-roll  and  spin  (in  Korea)  in  formation 
with  an  enemy  MIG.  We  both  recovered  shooting 
then  back  into  a spin.  On  the  third  recovery, 

I shot  him  down.  Through  the  spin  I tried  to 
keep  my  eye  on  him.  I don't  remember  worry- 
ing about  the  spin  problem.  I do  remember  his 
being  in  position  to  take  a shot  at  me  on  our 
second  recovery.  (3)  I believe  you  have  to 
charge  into  a fight  although  it  may  scare  the 
hell  out  of  you  which  is  good,  because  it 
gives  you  super  strength.  No  problem  or  thrill 
with  slipping  up  the  tail  of  an  unexpected  tar- 
get and  blasting  him  out  of  the  air." 

"I  began  to  get  dead  serious  when  asked  a 
question  like  this  because  the  354th  F.G. 

Ninth  A.F.  racked  up  an  air-to-air  kill  score 
that  was  not  equaled!  The  quality  that  made 
me  an  ace  was  the  ability  to  follow  example. 
What  made  me  an  ace  was  the  ability  I did  not 
know  I had,  to  never  let  those  examples  down. 
The  leadership  the  354th  had  in  its  Eaglestans, 
Howards,  Martins,  Beechavens,  and  Turners-was 
what  turned  me  on.  If  you  have  the  leadership 
the  rest  is  never  any  problem!" 

"(1)  Quick  reaction;  (2)  wide  field  of 
vision;  (3)  be  able  to  hear,  understand 
what  you  hear  and  think  while  you  are  maneu- 
vering and/or  shooting." 

"My  personal  observations  lead  me  to  believe 
that  the  person  with  the  most  desire  combined 
with  average  skill  and,  of  course,  courage 
would  be  the  top  pilot.  An  incident  occurred 
on  one  flight  led  by  an  officer  who  had  not 
engaged  in  combat  and  had  been  in  the  theater 
over  a year.  Bandits  were  called  in  by  me  - 
our  level  nine  o'clock.  Our  great  leader 
promptly  turned  right  to  three  o'clock.  This 
man  should  not  have  been  a fighter  pilot. 
Incidentally,  as  I was  ass-end  Charlie,  I 
promptly  returned  the  favor  and  left,  engaging 
in  combat  on  my  own." 

"In  trying  to  recall  a single  event,  I thought 
of  my  own  and  others'  experiences,  and  there 
seemed  to  me  an  important  common  ingredient 
that  perhaps  separates  the  exceptional  from 
the  average.  Air  discipline." 

"(1)  Ability  to  fly;  (2)  competitive  instinct 
and  a desire  to  win.  My  best  pilot  was  John 
Hampshire.  Fourteen  kills  in  about  five 
fights.  When  he  reported  for  duty,  I tested 
his  skill  against  my  own.  His  formation  was 
perfect.  At  the  top  of  a loop,  he  took  his 
hands  off  the  stick  and  made  faces  at  me. 


In  A.C.M.  I was  never  able  to  get  a decisive 
advantage.  When  we  landed,  he  was  all  excite- 
ment. The  action  was  over  the  field,  and  the 
crew  chiefs  were  in  on  the  debrief.  That  is 
where  I learned  that  half  the  fuel  had  been 
drained  from  his  tanks  to  get  a weight  advan- 
tage. His  explanation  was,  'I  want  you  to 
know  I'm  going  to  do  everything  I can  to  win,' 
and  that  he  did  until  a bullet  in  the  stomach 
brought  him  down.  He  ditched  in  a river,  gear 
up,  and  was  brought  ashore  where  he  lived  a 
few  hours." 

"On  two  missions  I dived  under  Zero  cover  to 
shoot  down  a bomber.  I was  not  concerned  about 
anything  except  getting  the  bombers.  Each  time 
the  direct  and  determined  attack  surprised  and 
confused  the  enemy.  See  your  job  and  do  it." 

"This  is  not  a single  event,  but  from  my  com- 
bat experience  I found  out  quickly  that  I was 
not  good  trying  to  shoot,  even  from  small 
deflection.  Therefore,  I always  had  to  fight 
hard  to  get  on  the  tail  for  a close  - no  deflec- 
tion shot.  With  the  less  sophisticated  equip- 
ment of  WWII  and  Korea,  an  expert  in  gunnery 
training  was  not  necessarily  the  making  of  an 
ace.  It  was  more  determination,  aggressiveness, 
and  knowing  how  to  fly  an  airplane  to  its  max- 
imum performance." 

"Aggressiveness  is  a basic  requirement,  coupled 
with  knowledge  of  your  equipment,  and  the  desire 
to  accomplish  your  objective  which  is  to  kill 
the  bogie.  Being  able  to  perform  flawless 
acrobatics/maneuvers,  etc.,  may  look  pretty, 
but  the  drive  to  press  the  attack  to  ensure  the 
kill  is  the  key  - the  only  payoff  is  the  results, 
i .e. , the  kill ." 

"Anger  at  being  jumped,  unexpectedly,  yet 
through  use  of  knowledge  of  aircraft  limits 
reverse  conditions  to  become  aggressor.  (Korea 
on  air-to-ground  mission  - at  low  altitude. 

Jumped  by  four  Chinese  aircraft  - dumped  all 
external  ord.  and  destroyed  all  four  enemy.) 

"I  got  into  my  first  one  on  one  'dogfight' 

(with  a fellow  student  pilot)  more  or  less  by 
accident  while  in  'Basic'  at  Merced,  California 
in  1942.  I got  whipped  but  good,  and  it  was 
humiliating.  1 made  up  my  mind  then  and  there 
it  would  never  happen  again  - that  I'd  tear  the 
wings  off  my  aircraft  before  I'd  ever  let 
anyone  else  get  the  best  of  me  in  any  form  of 
aerial  competition.  I refused  to  admit  there 
was  a better  'fighter  pilot'  than  I anywhere 
in  the  world,  and  I refused  to  be  beaten.  I 
haven't  lost  a real  or  'mock'  dogfight  since 
then. " 

"March  1945  - USS  Hornet  off  Kyushu  - under 
attack  by  Bettys-Nells  all  night  - at  general 
quarters  - very  little  sleep  - predawn  launch 
to  lead  16  fighters  on  sweep  over  Kanoye  air- 
fields; 300'  ceiling  - light  rain  - started 
launch  while  Hornet  under  attack  - six  fighters 
launched  - other  ships  were  firing  at  those  six 
VF  - we  doused  running  lights  - I broadcast 
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course,  speed,  and  rate  of  cUmb.  I had  six 
fighters  joined  before  daylight,  and  we 
approached  Kyushu  at  about  20,000',  three  sec- 
tions essentially  abreast,  ready  to  fight. 

About  15  Zekes  were  above  and  waiting  - I 
spotted  them  early  and  continued  climbing  to 
them.  The  Zekes'  attack  was  regular,  but  not 
well  coordinated.  We  maintained  a figure  8 
track,  covering  tails,  and  descending  slightly 
to  keep  good  speed,  and  importantly,  slow  the 
closing  rate  to  give  our  defense  a little  more 
time  to  cross  over  and  take  a shot.  Wingmen 
hung  on  and  also  got  in  some  bursts.  I got 
two  Zeros  here  and  the  other  guys  got  three  or 
four.  We  penetrated,  continued  toward  Kanoy. 
Resumed  climbing  - spotted  another  group 
(loose)  orbiting  north  and  above  - again,  we 
carried  it  to  them.  This, group  was  not  as 
aggressive  - they  made  indecisive  runs  and 
instead  of  breaking  down,  or  hard  away,  passed 
through,  straight  ahead,  obviously  inexperi- 
enced. I got  two  more  - my  wingman  got  two, 
section  leader  one,  and  four  more  got  one. 

My  third  se’ction  leader  got  two  - and  we  never 
broke  out  of  our  figure  8.  Following  this 
action,  we  patrolled  down  the  bay,  saw  other 
U.S.  and  enemies  in  a couple  of  dogfights,  but 
stayed  at  our  15-20  thousand  feet.  Shortly, 
we  saw  a Corsair  chasing  a Zeke  in  a vertical 
circle.  Another  Zeke  was  trying  to  close  on. 
the  Corsair  - two  on  one  didn't  seem  fair. 

We  nosed  over,  closed,  from  the  after  quarter 
for  near  no-deflection  runs.  I got  the  one  on 
the  Corsair's  tail,  and  the  three  section  took 
the  other  one.  The  Marine  Corsair  gained  on  me, 
and  was  he  happy.  Radio  and  navigation  aids 
had  been  shot  out.  We  made  one  more  turn 
around  the  beach.  They  made  runs  at  us,  and 
when  I ran  out  of  50  cal.  (and  a couple  of  my 
other  guys),  we  moved  over  and  ran  away  from 
them.  They  maintained  altitude.  Of  those 
six  pilots,  I was  the  leader  - and  had  most 
opportunities  to  shoot  - and  I was  the  only 
one  to  finish  war  as  an  ace.  But,  for  my 
money,  not  many  aces  would  have  shown  the  dis- 
cipline, alertness,  HEART,  perception  to  my 
moves,  and  the  spirit  to  take  'em  on.  In  my 
book,  those  fellows  flying  with  me  were  the 
real  aces.  It  is  much  easier  to  lead,  when 
backed  up  by  such  fine  naval  aviators  as  - 
my  wingman.  Little  Braze  - Wild  Bill,  my 
section  leader  - Ehiefie  (a  real  Indian  and 
highly  capable]^  the  tail  end  Charles  - Willis 
(none)  deceased,  my  regular  second  division 
leader,  and  his  section  leader  (Cullie). 

These  six  were  launched  in  most  adverse  condi- 
tions, then  the  deck  was  closed  until  dogfight 
about  40'  later.  Just  think,  we  had  the  whole 
thing  to  ourselves  for  about  40  minutes  and 
had  a barrel  of  fun." 

"Need  to  have  a sincere  desire  to  engage  in 
combat. " 

"(1)  Good  eyesight  - being  able  to  pick  up  the 
enemy  aircraft  before  anyone  else.  (2)  Being 
cool  and  not  getting  excited.  (3)  Good  air- 
craft position  and  this  is  the  result  of  #1. 

(4)  Being  aggressive,  knowing  your  ability  of 


of  your  aircraft  and  not  being  afraid.  (5)  I 
am  a small  man  (5'6",  145  lb);  but  when  I put 
on  a fighter,  I become  the  biggest  man  in  the 
squadron  or  in  the  air." 

"I  guess  a good  fighter  pilot  has  to  have  good 
eyes;  good  reflexes;  little  or  no  fear  of  con- 
sequences; not  necessarily  a good  thinke*;,  but 
one  who  is  dedicated  and  cock-sure  he  is  the 
best.  Wrap  this  all  up  in  a good  physical 
being,  and  here  I don't  mean  a super  athlete 
(some  have  scored  well  with  less  than  all 
their  extremities)  but  one  who  thinks  physical, 
because  this  is  a physical  way  of  life  - and  I 
guess  I ought  to  throw  in  a little  luck  - that 
hasn't  hurt  anyone." 

"Ability  to  react  quickly  - to  evaluate  the 
situation  quickly  and  accurately.  To  hesitate 
means  possible  defeat." 

"Yes,  during  Korean  War  I was  leading  a flight 
of  four  F-86s.  I decided  to  head  for  an  air- 
field about  75  miles  north  of  the  Yalu  River 
(against  the  rules?).  We  were  at  about  45 
thousand  feet.  Upon  arriving  1 noticed  numer- 
ous MIG  15s  taking  off.  We  were  aware  that 
the  enemy  sometimes  put  a protective  cap  over 
their  fields.  We  started  down  in  a high  speed 
dive.  As  we  passed  through  about  20  thousand, 
my  #3  man  and  myself  both  observed  abput  20  MIG 
15s  circling  the  airfield.  Since  we  had  lots 
of  speed,  we  continued  on  down  after  the  MIG 
that  had  just  taken  off.  Before  the  protective 
MIG  cover  could  get  to  us,  we  had  shot  down 
five  MIG  15s  in  about  one  or  two  minutes.  We 
broke  south  at  once  and  by  using  some  cloud 
cover  and  some  rather  violent  maneuvering 
managed  to  evade  the  MIGs  we  had  left  above  us. 
Were  we  foolhardy?  1 don't  think  so.  I think 
it  was  a good  calculated  risk  under  the  circum- 
stances. It  paid  off.  Five  MIG  15s  destroyed. 
No  losses." 

"It  was  my  seventh  combat  mission.  I was  lead- 
ing a flight  of  four.  We  spotted  a group  of 
45  German  dive  bombers  escorted  by  10  ME  109s  - 
altitude  about  6,000'.  They  were  attacking  our 
ground  forces.  We  went  in  to  attack  the  bombers 
from  the  rear  knowing  they  did  not  have  rear 
guns.  After  shooting  down  two,  1 started  on 
the  third  thinking  it  was  easy.  ME  got  me.  I 
parachuted,  was  rescued  and  returned  to  my  own 
field.  One  of  the  group's  other  pilots  ques- 
tioned me  about  my  attack  methods,  and  1 told 
him  if  he  saw  any  of  that  type  aircraft  to  slow 
down  and  get  them  from  the  rear  at  same  level. 
The  next  day  he  was  on  a similar  mission  and 
got  four  of  them.  He  told  me  he  did  as  suggest- 
ed and  also  worked  his  way  up  under  them  when 
escort  appeared,  returned  home  out  of  ammo. 

Know  the  enemy,  your  aircraft  and  be  alert; 
stay  calm.  He  did  and  became  an  ace  with  10 
kills.  He  beat  me,  damn  it." 

"First  there  are  a hell  of  a lot  of  good  WWll 
fighter  pilots  who  are  not  aces.  Also,  many  of 
them  are  not  aces  because  they  always  did  the 
job  assigned  and  did  it  well.  For  example,  if 
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you  were  assigned  to  close  bomber  cover  and 
you  did  your  job,  you  very  seldom  shot  down 
a plane  - your  job  was  to  snap  shoot  or  fly 
so  as  to  break  up  the  enemy  close-in  attack. 

You  could  not  concentrate  long  enough  to  shoot 
down  the  plane  or  the  next  enemy  fighter  would 
get  by  you.  How?  There  are  some  guys  around 
today  that  didn't  play  these  roles;  and  they 
ran  up  a score,  but  people  know  who  they  are, 
and  they  have  to  live  with  their  actions. 
Finally,  the  enemy  is  always  at  least  as 
scared  as  you  - only  so  many  planes  can  con- 
centrate on  a target  - so  a gutty,  aggressive 
team  action  always  pays  off." 

"An  ace  has,  aoove  all  other,  an  instinct  to 
kill.  Some  pilots  do  not  possess  this  trait. 
Some  men  simply  cannot  kill.  Once  this  is 
recognized  by  the  individual,  then  opportunity 
is  the  remaining  ingredient  for  air-to-air 
kills." 

"To  be  scared  as  hell  until  the  enemy  is 
sighted.  Then  to  quickly  evaluate  the  situa- 
tion and  take  up  the  offensive.  To  lead  in  an 
inspiring  manner  giving  encouragement  and 
example  to  all.  Never  give  up  no  matter  what 
the  odds.  Concentration." 

"In  China  (July  1942)  I was  23rd  Gp.  Cmdr — 
(CATF).  . .Lt.  Dallas  Clinger  was  my  wingman 
(after  this  action).  We  had  just  landed  with 
the  'group'  (some  dozen  P-40Es)  for  refueling 
after  combat  (Ling  Ling)  - as  we  made  all  the 
haste  possible  - refueling  from  old  4 gallon 
British  jerry  cans — we  observed  outnumbering 
Jap.  Zeros — coming  towards  us,  just  as  though 
they  knew  we'd  be  wide  open  - on  the  ground. 

But  as  they  approached  we  noted  two  P-40s  - 
they  were  chasing.  Of  course  all  the  slower 
P-49S  could  do  was  get  their  noses  down  and 
run  - to  make  the  famous  maneuver  'getting  the 
hell  out  of  there.'  Because  it  was  not  only 
an  unwritten  'law'  it  was  from  an  order  - down 
from  the  Old  Man,  'Never  turn  with  a lighter 
Zero.'  But  to  our  consternation,  one  of  the 
P-40s  made  a 180  degree  turn  and  engaged  the 
pursuing  enemy  - head  on.  Each  time  the  Zeros 
turned  themselves  and  did  their  best  to  shoot 
him  down-  in  a sort  of  replay  of  long  outmoded 
WWI  tactics  - doqfiqhtinq.  To  make  a long 
story  short,  this  lone  P-40  turned  back  into 
the  enemy  gaggle  three  times,  damaging  two  and 
destroying  one  Zero  - later  confirmed.  By 
that  time  we  had  a few  of  our  fighters  refueled 
and  back  in  the  sky  - to  maybe  help.  The 
enemy  never  got  to  strafe  us  helpless  as  we'd 
have  been  had  they  absolutely  ignored  the 
'foolish'  lone  plane.  Later  that  afternoon 
when  I had  stopped  'biting  my  nails'  - I found 
the  pilot  of  the  attacking  P-40  - this  Wyoming 
cowboy  - Lt.  Dallas  Clinger.  'Lt.,'  I said, 
trying  to  keep  from  courtmartial ing  him  there 
on  the  spot,  'you  know  damn  well  you  violated 
Gen.  Channault's  written  orders  about  never, 
never  turning  with  a Zero  - oh,  you  were  lucky 
and  maybe  you  kept  us  on  the  ground  from  being 
strafed,  but  nevertheless  - the  Old  Man  will 
be  asking  me  - so  I am  asking  you  - why  in  the 


hell  did  you  do  it?'  Well,  all  this  super 
confident  green-horn  said  was.  '1  just  got  so 
mad,  sir  - when  I saw  you  all  down  there  re- 
fueling, and  so  1 attacked  - I couldn't  help 
it.  Colonel.  Maybe  I was  wrong,  but  I attacked.' 

"My  point  here  is  simply  this  - here  was  a kid 
from  Afton,  Wyoming,  a fine  pilot  but  inexper- 
ienced - in  a strange  land  - outnumbered  so 
much  it  was  staggering  (estimated  something 
like  hundreds  to  our  49)  as  far  as  aircraft 
went  in  China  - and  everyone  knew  it  - YET  HE 
NEVER  HAD  A DEFENSIVE  THOUGHT  - HE  TURNED  AND 
ATTACKED. 

"No  wonder  I chose  him  for  my  wingman  - I sup- 
pose I explained  to  General  Chennault  something 
like,  'Sir,  I will  watch  him.'  In  three  months 
2nd  Lt.  Clinger  was  an  ace  - and  maybe  1 am 
still  around  because  he  became  my  wingman. 

"#2  - Johnny  Alison  - a Major  then  - a retired 
Major  General  now  - who  became  Vice  President 
of  Northrop  Aircraft.  On  the  night  of  July  31, 
1942,  John  R.  Alison  from  Micanopee,  Florida, 
shot  down  three  Jap  bombers  and  damaged  two 
others  over  Heng  Yang,  China;  the  first  night 
action  of  the  war  over  China;  the  first  time 
the  beleagered  Chinese  had  ever  seen  the  enemy 
destroyed  over  their  defenseless  cities.  Only 
thing  was  in  making  his  attack  - right  up  the 
tails  of  the  formation  of  bombers  - Johnny  had 
to  simply  ignore  the  waist  guns  and  the  tail 
guns  and  bore  on  in  for  the  kills.  So  by  the 
time  he  had  gotten  to  three  and  four  he  was 
hit  himself  - on  fire  and  about  to  go  down  in 
flames  - yet,  he  continued  to  deliver  fire 
until  the  last  Jap  was  either  going  down  or  had 
broken  away  - its  attack  abandoned.  Why  was 
Johnny  attacking  alone  - I had  better  explain 
that  to  the  uninitiated.  We  had  agreed  by 
assigning  altitudes  to  our  fighters  - four  of 
them  as  I recall.  So,  as  the  enemy  attacked 
that  full  moon  night  - up  the  Siang  Kiang  River 
from  Hankow  to  Heng  Yang  (a  bombers  moon  the 
Chinese  always  called  such  a night  of  terror) 
our  other  three  fighters  were  at  staggered 
altitudes  and  so  as  not  to  hamper  whoever  be- 
came the  lucky  one  at  the  enemy's  selected 
altitude  - we  had  to  just  watch  and  wait.  But 
anyway,  as  the  formation  was  broken  up  - most 
of  it  on  fire  - all  I could  do  was  watch  Johnny 
Alison  in  his  lone  P-40  - in  flames  himself  - 
it  seemed  that  fighter  of  his  was  trailing  a 
30  foot  plume  of  solid  flame.  Radio  silence 
may  have  been  the  order  of  the  day  - but  suddenly 
the  air  was  filled  with  instructions  to  Johnny, 
'Get  out  - Johnny  - bail  out  - you're  on  fire.' 
Over  and  over  we  called  to  him  - only  to  see  his 
plane  crash  into  the  river. 

"Again,  to  make  a long  story  short  - and  besides 
I have  already  written  this  incident  up  (at 
length  in  a book  that  is  a good  34  years  old). 
When  the  cheering  Chinese  had  fished  Johnny 
Alison  from  the  river  and  brought  him  back  to 
the  field  across  from  the  city  - my  first  ques- 
tion as  I grabbed  his  hand  and  cheered  him  also 
was,  'What  was  the  matter,  Johnny  - we  were 
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yelling  at  you  to  jump  - you  were  on  fire 
from  prop-spinner  to  tail.  Didn't  you  hear 
us?'  I never  will  forget  if  it  was  134  years 
instead  of  a mere  34,  'Oh,  1 heard  you  all. 
Colonel  - but  I had  to  stay  with  the  plane  - 
we  needed  the  parts.  I could  see  the  whole 
thing  reflected  in  the  river  - I just  had  to 
ride  it  in. ' 

"Get  that  - 'We  needed  the  parts!'  - which 
was  typical  out  there  in  China  at  the  end  of 
the  supply  lines  - besides  we  knew  we  were 
mighty  far  down  on  the  totem  pole  of  supply 
anyway.  But  this  fighter  pilot  - with  his 
plane  taking  down  to  a fiery  grave  - was  not 
thinking  of  defense  or  abandoning  anything  - 
much  less  just  saving  his  life  - he  was  think- 
ing about  the  future  and  tomorrow  and  getting 
that  plane  either  flying  again  or  at  least 
to  save  some  of  its  vital  parts  for  what  we 
know  now  as  'cannibalization.'  You  see  we 
had  a factory  at  Loiwing  or  Lashio  - in 
the  China  Theatre  - where  the  Chinese  would 
take  about  eight  or  nine  or  even  ten  wrecked 
planes  and  build  one  that  was  combat-worthy 
from  all  the  parts.  It  sort  of  reminds  me 
again  about  the  Israeli  Air  Force  I mentioned 
earlier  - maybe  we  were  the  same  way  then  - 
we  were  so  short  of  everything  - manpower, 
plane  power,  ammunition,  gasoline  - all  we 
thought  about  was  soulless  hardware  - 
but  these  were  our  national  monuments,  heavy 
and  cumbersome  and  slow  as  those  old  cast-off 
P-40s  were.  (Major  Alison  received  DSC  for 
this  valor.) 

"In  closing  this  - I could  sit  here  and  write 
another  book  about  what  I think  about  fighter 
pilots  and  how  varied  and  different  they  are  - 
but  I will  mention  just  one  more  - who  died  - 
running  for  his  P-40  at  Ling  Ling  or  Lieuchow 
or  someplace  like  that  - instead  of  running 
for  cover  and  a slit-trench  for  safety.  His 
name  was  Johnny  Hamshire  and  he  shot  down 
14  enemy  aircraft  in  about  that  number  of 
days  - surely  half  that  many  weeks  - he  might 
well  have  been  one  of  the  world's  leading 
aces  - had  he  not  been  killed  that  day.  He 
was  the  most  offensive  minded  man  I ever  met. 
But  while  his  flight  was  refueling  in  came 
the  Japanese  fighters  to  hit  the  grounded 
planes,  and  of  course  he  had  only  one  thought 
get  up  there  - in  his  cockpit  - start  that 
P-40  and  attack.  But  he  died.  Therefore, 

I close  this  epistle  with  the  thought  that 
to  me  the  greatest  qualities  I ever  observed 
to  illustrate  those  real  qualifications  of 
an  ace  is  just  that,  'I  had  to  attack,  sir  - 
I couldn't  help  it.  Colonel!'  Hadn't  Johnny 
Alison  really  said  about  the  same  thing  - 
when  he  said,  'We  needed  the  parts,  sir  - we 
needed  the  parts.'  Oh,  Major  Alison  went  on 
and  on  to  become  a double  ace,  and  is  still 
going  strong  - and  he  surely  knew  Johnny 
Hamshire,  too  - because  he  was  his  squadron 
CO.  Of  course,  Johnny  was  one  of  the  best 
pilots  there  ever  was  in  this  world  - I could 
write  a book  about  him  - so  were  those  other 
two  good  pilots.  But  the  only  thing  any  of 


them  really  had  in  common  was  that  feeling 
that  fairly  leaped  out  at  you  - 'Attack. 

Never,  but  never,  have  a defensive  thought.'" 

"(1)  With  training,  confidence  developed. 

(2)  Throughout  my  30  years  in  military  avia- 
tion, most  of  the  time  I flew  in  fighter  avia- 
tion, it  was  found  that  when  I could  maintain 
20-30  hours  of  flying  time,  I felt  as  though 
1 had  a true  proficiency  with  flying  - the 
aircraft  I was  flying  and  the  unknown  situa- 
tions that  could  be  encountered.  This  time 
was  acquired  under  a well-directed  program 
with  supervision.  Even  so,  I personally  knew 
my  limitations  and  tried  to  work  them  out  my- 
self. (3)  In  contrast,  when  I served  on 
staff  assignments  where  some  eight  hours/month 
was  required  to  bore  holes  in  the  sky  - I 
lost  proficiency.  (4)  An  intensive  refresher 
course  is  important  to  revamp  a staff  pilot 
back  to  fighter-combat  proficiency.  (5)  In 
peacetime,  fighter  pilots  can  be  assigned 
additional  duties  but  in  wartime  - this  indi- 
vidual should  be  highly  specialized  and  not 
be  subjected  to  additional  loads  other  than 
training  and  combatting  in  this  specialty. 

(6)  A squadron  and  group  commander  must  be  an 
active,  proficient  leader.  He  must  strive 
more  than  his  subordinate  to  maintain  flying 
proficiency.  His  command  duties  is  not  so 
much  'directing'  as  'follow  me.'" 

"I  recall  a mission  in  China  when  about  ten  of 
us  in  P-40s  were  pursuing  a flight  of  Zeros. 
Johnny  Alison  was  already  in  the  air  before 
we  took  off  and  had  made  contact.  He  called 
us  and  gave  us  the  position  of  the  Zeros  saying, 
'you  guys  come  on.  I've  got  30  Zeros  cornered!' 
Johnny  was  the  best  fighter  pilot  to  strap  on 
a P-40  (never  an  ace  maybe , but  the  best  of 
all).  The  quality  illustrated  is  aggressive- 
ness, eager  to  fight  - good  at  it!!" 

"After  shooting  down  one  aircraft  - going 
from  32,000'  down  to  7,000'  - I climbed  up 
to  27,000'  again  in  hopes  of  engaging  another 
aircraft  - rather  than  going  home.  I was 
successful  that  day  - perhaps  a bit  foolish, 
but  it  paid  off.  The  next  time  I climbed  back 
up  after  a similar  (double)  kill  I ran  into  an 
F-51  and  he  shot  me  down  (my  mistake).  Thus, 
my  aggressiveness  paid  off  once,  but  almost 
cost  me  ray  life  the  second  tirae.  1 would  rate 
aggressiveness  #1  as  an  attitude,  but  it  is 
not  something  necessarily  manifested  outwardly. 
If  it  can  be  identified  through  tests,  then  I 
would  favor  that  kind  of  person." 

"I  remember  very  clearly  one  of  our  leading 
aces  saying  on  the  radio  during  a rather  large 
hassle,  'I've  got  about  six  of  'em  cornered 
back  here!'  That,  to  me,  is  a graphic  demon- 
stration of  the  spirit  and  guts  that  it  takes 
to  make  an  ace!" 

"My  very  first  'real'  engagement  of  the  enemy 
and  my  first  kill,  began  after  a B-17  bomb  run, 
when  a buddy  and  I saw  about  a dozen  109s  below 
and  obviously  heading  home.  We  dove,  getting 
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good  speed  and  went  after  them.  About  a 
thousand  yards  from  them,  they  split,  half 
turning  left  and  half  to  the  right,  when  the 
question  was  put  to  me,  'which  group  do  we 
choose?'  He  had  his  answer  in  seconds,  'Why 
share,  you  can  have  the  group  going  right, 

> I'll  take  the  group  going  left  - good  luck.' 
As  1 recall,  he  got  two  confirmed,  and  I 
ended  up  with  one  kill,  one  probable  and  a 
damage. " 


"I  wanted  to  meet  an  enemy  fighter  aircraft 
in  combat  in  the  worst  way,  and  didn't  care 
what  the  odds  were,  i.e.,  two  against  two, 
four,  or  the  whole  enemy  Air  Force.  Just 
finding  a MIG  in  North  Vietnam  was  generally 
difficult  if  you  were  flying  MIG  Cap  missions. 
Therefore,  I obtained  as  much  information 
possible  during  the  entire  tour  on  their 
probable  airborne  locations,  geographical 
position,  altitude,  etc.  This  paid  off  twice. 

I attacked  a flight  of  16  MIGs  with  no  F-4 
losses.  Having  the  eyes  to  acquire  these 
flights  was  extremely  important  also.  So  I 
guess  it  boils  down  to  an  intense  desire  for 
air-to-air  combat,  good  eyes  and  self  confi- 
dence (assuming  flying  skill  is  there)." 

"Contrary  to  popular  ideas,  shooting  ability 
and  not  flying  ability  has  always  been  the 
fighter  pilot's  most  important  asset,  and  the 
asset  most  likely  to  make  him  an  ace.  Air-to- 
air  shooting  ability  is  an  esoteric  skill, 
and  few  indeed  are  ever  to  master  it  thorough- 
ly. Those  blessed  with  the  native  ability  to 
shoot  at  a moving  target  from  a moving  plat- 
form, the  movement  of  both  being  in  three 
dimensions,  will  almost  certainly  become 
aces,  ever  if  they  are  not  exceptional  pilots. 
In  comparing  the  smooth-as-silk  pilot  and  the 
ham-fisted  rough  pilot,  the  smooth  pilot's 
reactions  in  the  air  are  predictable  to  an 
enemy  pilot  of  similar  skills.  Where  the 
smooth  pilot  takes  evasive  action,  the  enemy 
can  sometimes  predict  it  in  advance  and  bring 
his  guns  to  bear  with  a well  aimed  burst.  The 
ham-fisted,  rough  pilot,  on  the  other  hand, 
often  reacts  unpredictably  when  bounded.  His 
salvation  lay  in  his  sheer  brute  force.  He'll 
wrench  his  aircraft  into  turns  an  experienced 
pilot  would  never  attempt.  But  smooth  or 
rough,  the  fighter  pilot  who  could  shoot  was 
likely  to  become  an  ace  if  given  adequate 
opportunity." 

"Confidence  in  oneself  and  in  the  aircraft; 
aggressiveness;  thorough  knowledge  of  the 
capabilities  of  your  weapons  and  of  the 
enemy's  limitations." 

"Determination;  self-centered  egotism;  belief 
in  oneself  and  his  ability;  self-discipline 
to  study  enemy  aircraft." 

"When  I first  joined  the  Eighth  TAC  Fighter 
Wing  at  U'Bon  Royal  Thai  Air  Force  Base, 
Thailand,  in  September  1967,  the  Wing  Comman- 
der was  Colonel  Robin  Olds.  He  had  with  him 
a nucleus  of  older,  highly  experienced  tactical 
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fighter  pilots  who  functioned  as  squadron 
commanders,  operations  officers  and  flight 
leaders,  and,  I believe,  this  was  the  most 
efficient  and  aggressive  winq  of  fighter 
pilots  throughout  the  Air  Force  at  the  time. 

"However,  as  Colonel  Olds  and  these  other 
experienced  fighter  pilots  finished  their 
tours,  they  were  replaced,  for  the  most  part, 
by  pilots  coming  out  of  SAC,  MAC  and  ATC  - 
essentially  non-fighter  pilots  who  had  gone 
through  a six-to-nine  month  training  course 
in  the  F-4  and  were  now  considered  combat 
qualified,  fhese  'new  heads'  had  to  be  lucky 
to  survive  100  missions  over  North  Vietnam, 
much  less  become  top  scorers.  I think  this 
policy  of  rotating  pilots  out  of  non-tactical 
aircraft  and  into  a high  performance  tactical 
fighter  like  the  F-4  or  F-105,  and  then  plac- 
ing them  in  a combat  environment  with  minimal 
training  was  ridiculous.  It  would  have  been 
better  to  assign  new  pilot  training  graduates, 
those  who  could  handle  it,  to  F-105s  and 
front-seat  F-4  positions  rather  than  these 
retreads  from  SAC,  MAC  and  ATC.  Either  that, 
or  require  that  the  experienced  TAC  fighter 
pilots,  such  as  Colonel  Olds  and  this  nucleus 
I mentioned  earlier,  fly  more  than  one  combat 
tour." 

"After  making  our  first  attack  on  a SAM  site 
(April  1966)  Hanoi  - #2  man  said,  'Lead,  that 
was  'Shit  Hot'  - find  us  another  one.'  We  did 
and  he  (Harley  Wyman)  put  all  his  bombs  right 
in  the  center  - (bye-bye  radar).  Both  sites 
were  confirmed  out  (one  mission).  Heart  and 
desire  to  do  the  mission.  (First  multi-SAM 
kill  of  the  war  - both  sites  confirmed  - out)." 

"I  am  personally  acquainted  with  all  three  of 
the  Air  Force  aces  in  Vietnam.  The  qualities 
which  best  typify  these  individuals  are  as 
follows;  (1)  Generally  excellent  in  aircraft 
handling  and  tactics;  but  this  not  the  most 
important.  (2)  Imaginative  and  planned  to 
get  kills  by  taking  advantage  of  the  opportu- 
nities presented.  (3)  Their  ability  to 
execute  plans  carefully  made  and  considered. 

(4)  Coordination  in  two-place  aircraft  among 
crew  members.  The  ability  to  take  advantage 
of  opportunities  with  careful  preplanned  tac- 
tics was  critical.  A typical  situation  is  as 
follows:  Enemy  fighters  would  typically  use 

different  bases  to  launch  and  recover. 

Because  of  the  limited  high  speed  engagement 
capability  of  the  MIG  21,  recovery  could  be 
predicted  depending  on  the  direction  of  the 
strike.  One  of  the  rover  MIG  CAP  tactics 
would  be  to  penetrate  the  SA-2  SAM  rings  at 
low  altitude  and  attempt  to  engage  the  MIGs 
on  recovery.  Probably  BO'y  of  the  squadron's 
kills  resulted  in  such  tactics,  since  the  MIR 
pilots  were  ill-prepared  to  fight  in  this 
environment.  It  was  extremely  difficult  to 
engage  the  MIGs  at  your  convenience,  since 
their  excellent  GCI  precluded  your  ability  to 
intercept  prior  to  their  attack.  On  a flight 
I was  on,  we  caught  a MIG  21  recovering  at 
Fuc  Yen  on  the  downwind  to  RCA  (it  was  their 
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procedure  to  get  vectors  straight  in)  - he 
was  at  low  airspeed  maneuvering.  We  came  on 
the  deck  at  Mach  .95  to  avoid  the  SAMS  and 
got  a snapshot  kill  with  guns.  This  was  not 
just  luck,  this  was  a carefully  planned  and 
executed  calculated  risk.  We  were  fired  upon 
by  SAMS  while  in  this  engagement.  Our  ability 
to  defend  ourselves  from  SAMS  was  vitally 
dependent  on  precise  tactics  of  the  rest  of 
the  flight." 

"So  many  of  the  engagements  required  the  con- 
fidence and  knowledge  to  react  at  a second's 
notice  to  a given  situation  (i.e. , pulling 
off  the  target  and  seeing  an  enemy  aircraft 
in  front  of  you  and  being  able  to  adjust 
from  an  AB  to  an  A/A  environment.)" 

"Yes,  aggressiveness  (tempered  with  judgment) 
can  even  be  displayed  on  air-to-ground  mis- 
sions (I  was  an  air-to-ground  pilot  at  U-Bon's 
Eighth  TFW  Wolfpack).  The  lower  a person 
dive-bombs,  the  more  accurate  he  is.  And 
when  a person  continues  to  drop  at  a lower, 
more  accurate  altitude  even  when  AAA  is  flying 
all  around  him,  he  will  also  be  likely  to 
'fill  his  windscreen  with  enemy  airplane  and 
blow  his  stuff  away.'  A person  who  does  not 
rationalize  in  air-to-ground  work  is  not 
likely  to  do  so  in  air-to-air  work.  Instead, 
he  will  press  the  attack  at  all  costs.  This 
is  my  philosophy  and  the  one  I flew  by  when  I 
was  flying  in  SEA/NVN." 

"(1)  The  spirit  of  attack  born  in  the  heart 
of  a brave  man  (Galland).  (2)  My  first 
engagement  occurred  on  8 July  1972  when  I 
was  attacked  by  three  MIG  21  aircraft.  Aft-er 
the  third  flushed  through,  I started  after 
him  and  fired;  he  went  into  the  biggest, 
blackest  cloud  in  NVN  and  I went  in  right 
after  him.  When  I came  out  the  other  side, 
he  was  still  in  my  pipper  and  I got  him.  I 
really  wanted  to  kill  MIGs.  The  next  time  I 
saw  one  1 chased  him  for  20  miles  across  NVN 
and  fired  everything  on  board  - no  kill.  In 
December  1972,  when  operation  Linebacker 
started,  I was  scheduled  to  go  on  R&R  to 
Hawaii  with  my  wife.  I cancelled  the  trip 
to  get  a chance  to  get  another  MIG.  I really 
wanted  to  be  an  ace." 

"First  requirement  is  the  opportunity.  A 
fella  needs  a reasonable  war  with  acceptable 
ROE.  Second  requirement  is  for  the  proposed 
ace,  besides  being  good,  to  have  personal 
organization  which  is  developed  through  train- 
ing of  mind  and  physical  capabilities.  After 
these  squares  are  filled  - attitude,  a good 
fighter,  missiles,  a gun  and  a little  luck 
are  all  that's  required  for  a person  to  become 
an  ace.  (Naturally  as  the  plot  thickens  - 
fighting  over  heavily  defended  areas  against 
great  odds  - a willingness  to  take  chances 
and  accept  a few  shots  becomes  important.)" 

"An  apparent  coolness  under  fire/pressure, 
i.e.,  individual  effectiveness  seems  to 
increase  as  the  pressure  mounts.  This  man 


will  do  well  in  any  performance  situation,  may 
not  do  so  well  nor  even  be  noticeable  in  the 
mundane  low  pressure  environment.  Coolness 
under  pressure  becomes  apparent  as  the  pres- 
sure/stakes mount.  One  can  almost  see  the 
excitement,  fear,  etc.,  wash  out  to  be  re- 
placed by  the  cool,  methodical  effective 
'machine. ' " 

"There  are  so  many  events  it  would  be  impossi- 
ble to  describe  all.  Attributes  required: 

(1)  Certain  basic  intelligence  level. 

(2)  Dedication  to  air  superiority. 

(3)  Attitude.  (4)  Aggressiveness. 

(5)  Leadership  ability." 

"(1)  Desire  to  become  an  ace.  (2)  Preparation 
practice.  (3)  Rigid  discipline.  (4)  Teamwork 
(5)  Supreme  optimism." 

"Desire  to  engage,  good  tactician,  desire  to 
press  fight  once  engaged.  Self  confident, 
well  disciplined,  responds  well  under  high 
mental  and  physical  stress." 

"Competitive  spirit.  Guts.  Knowledge  of  the 
air-to-air  situation  and  an  absolute  urge  to 
get  into  a position  of  advantage.  Unyielding 
desire  coupled  with  the  capability  and  dexter- 
ity to  perform  in  the  air-to-air  arena  - few 
can  do  i t! ! " 

"Outstanding  ACM  ability;  aggressiveness;  cool 
head;  prior  game  plan  well  thought  out.  The 
four  above  qualities  are  required  to  become 
an  ace  plus  a lion's  share  of  chance  or  luck. 
This  is  illustrated  in  any  well  briefed,  well 
flown  and  well  debriefed  ACM  hop." 

"Yes,  a friend  of  mine  - Randy  Cunningham. 

(1)  Aggressive;  (2)  cool  under  stress; 

(3)  excellent  stick  coupled  with  common  sense; 

(4)  under  the  surface  cocky  as  hell  but  not 
apparent  to  those  not  associated  with  the  air 
to-air  breed;  (5)  consistent.  All  of  these 
qualities  are  present  during  each  of  his  kills 

"My  kills  were  determined  long  before  the 
engagement.  As  the  engagement  began,  I dis- 
tinctly remember  that  there  was  not  a doubt 
in  my  mind  in  most  cases  as  to  what  should  be 
done.  In  fact,  the  only  problems  I had  arose 
in  those  instances  where  I had  not  given  ade- 
quate thought  to  some  individual  eventuality 
and  was  forced  to  make  decisions  which  were 
safe  and  correct  but  were  not  aggressive 
enough  (training  dictates,  and  rightly  so, 
personal  responsibility  for  the  aircraft  you 
are  in).  A person  must  commit  themself  to 
what  they  are  doing  and  direct  an  inner  power 
and  thought  to  what  they  are  doing." 

"You  miss  the  point!  An  'ACE'  has  no  quali- 
ties - he  has  timing  and  luck  on  his  side. 

An  'effective  combat  pilot'  must  have  the 
following  qualities:  (1)  a thorough  knowledge 

of  his  aircraft  and  the  hand/eye  coordination 
to  take  his  plane  to  controllable  limits  at 
will;  (2)  he  must  have  the  decisiveness  to 
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know  when  to  back  down  and  the  maturity  to 
accept  failure.  He  must  learn  all  he  can 
from  his  mistakes  uecause  he  will  not  always 
find  himself  at  6 o'clock;  (3)  A combat  pilot 
must  assume  a heavy  heart  in  awesome  respon- 
sibility but  he  must  hunger  for  light-hearted 
competition  in  achieving  the  final  victory; 

(4)  The  fighter  pilot  must  have  ultimate 
awareness  of  his  own  capabilities  that  he 
might  better  understand  those  with  whom  he 
flies;  (5)  He  must  not  waiver  from  a decision 
made,  but  he  must  pray  to  God  he's  made  the 
right  decision." 

"I  was  assigned  to  Randy  Cunningham's  room 
after  he  had  been  detached  from  VF-96  (I  was 
aboard  for  only  two  weeks).  He  nad  left 
two  items  - a stack  of  well-thumbed  books  by 
WWI  and  WWII  aces  and  a dog-eared  NATROPS 
manual.  He  knew  the  airplane  and  was  smart 
enough  to  learn  from  other's  recounts  of  their 
experiences.  Moral:  Personal  motivation  and 

innate  skills  are  one  thing,  but  success 
requires  a thoughtful,  dedicated  understanding 
of  the  concept  of  air-to-air  fighting." 

"Varied  events  occurred  which  involved  both 
fighter  pilots  (F-4/F-8)  and  attack  pilots 
(A-7/A-6).  In  all  cases,  I believe,  the 
most  important  single  factor  is  an  individu- 
al's ability  to  continue  to  think  and  make 
rational  decisions  under  the  most  adverse 
conditions.  Any  man  can  be  overloaded;  but 
the  last  man  to  lose  his  head  might  generate 
a situation  that  permits  a kill  or  allows  him 
to  get  out  of  a very  bad  situation  alive. 
Flight  ability,  weapons  knowledge,  etc.,  is 
assumed. " 

"Unless  a person  is  very  lucky,  success  in 
combat  is  directly  related  to  preparation.  I 
am  using  preparation  in  its  largest  sense  to 
include  training,  physical  skills,  physical 
conditioning,  good  tactics,  etc.  A large  part 
of  preparation  is  thinking  through  possible 
situations,  so  your  response  is  almost  auto- 
matic. The  most  difficult  element  in  early 
combat  is  thinking  (just  as  thinking  was  dif- 
ficult on  the  first  training  flights).  The 
pilot  who  can  get  through  this  mental  barrier 
and  is  reasonably  lucky  will  be  a success  in 
combat. " 

"Aggressive  but  professional  - certainly  being 
a good  'stick/throttle'  ACM  pilot  is  a must, 
but  equally  important  is  knowing  your  weapon 
system  tnorougnly,'  Must  have  opportunity  - 
many  fighter  pilots  let  the  other  guy  take 
the  real  tough  missions  because  of  fear  or 
lack  of  confidence." 


/ 
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The  situation  must  be  assessed  completely 
because  your  decision  will  more  than  likely 
be  irreversible  once  committed.  For  a straight 
one-on-one,  the  decision  is  nothing.  As  you 
get  more  and  more  airplanes,  the  situation  has 
to  be  carefully  cons’dered.  To  me  the  over- 
whelming qualities  are  desire  to  win  - desire 
to  engage,  ability  and  headwork. 

"Early  in  combat  - December  1942  - when  we 
arrived  in  North  Africa,  we  gave  our  P-38  air- 
craft to  the  First  and  Fourteenth  Fighter 
Groups  to  restore  their  losses.  With  no 
experience  and  no  tactics  resolved,  we  taught 
ourselves  as  best  we  could  with  an  average  of 
four  aircraft  per  fighter  mission.  The  first 
10  missions  I flew,  we  lost  10  pilots.  We 
joked  about  our  odds  of  returning.  Wo  were 
busy  being  defensive  - always  outnumbered. 
Members  of  my  squadron  were  registering  kills; 
not  me.  I got  my  first  kill  3 March  after  we 
had  grown  to  12-ship  flights;  had  settled 
down  with  solid  tactics;  had  gained  confidence  - 
full  throttle  was  for  takeoff.  I had  progressed 
from  wingman  to  element  leader  and,  with  this 
kill,  became  a flight  leader  - chances  became 
more  available.  A fighter  pilot  needs  HEART 
for  combat;  needs  HEAD  to  know  how  and  when  to 
engage  the  enemy;  needs  the  HAND  (skill  and 
experience)  of  a professional.  Other  players 
can  score;  but  without  all  three  "H's,"  they 
only  form  the  other  essential  ingredient  - 
superiority  of  numbers  when  using  the  best 
platform(s)  available.  Select  fighter  pilots  - 
select  the  best  fighter  pilots  to  lead  at  each 
echelon  - many  a good  fighter  pilot  got  lost 
flying  the  wing  of  a senior  who  didn't  have 
the  heart  or  head  to  lead  preflight.  In  the 
beginning  of  my  combat,  I guess  mentally  I 
had  with  our  odds  - three  chances  to  survive  - 
only  one  to  fail.  Since  I did  not  question 
authority,  how  could  I lose?  Yet,  because  of 
my  report  on  a mission's  effectiveness,  con- 
tinued missions  of  this  type  were  discontinued.' 


"Given  all  things  being  equal  except  the 
individual,  it  seems  to  me  the  most  observable 
quality  is  the  ability  to  decide  when  to  stand 
and  fight,  and  when  to  decide  to  fight  another 
time.  First  the  desire  must  be  there  - it 
must  be  overwhelming,  but  it  must  be  tempered 
by  a common  sense  (experience,  if  you  will). 
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3.6.3  Ratings  of  the  Personal  Attributes  of 
an  Ace  - As  a result  of  our  early  interviews  and  a 
review  of.the  popular  literature,  12  personal  char- 
acteristics of  aces  were  identified  for  inclusion 
in  our  Pilot  Effectiveness  Questionnaire.  These 
characteristics  consisted  of  the  desire  to  achieve, 
aggressiveness,  courage,  determination,  endurance, 
initiative,  leadership,  team  cooperativeness,  will- 
ingness to  take  calculated  risks,  physiological 
stress  tolerance,  psychological  stress  tolerance, 
and  anxiety  tolerance.  This  listing  is  representa- 
tive of  those  personal  characteristics  which  the 
pilots  interviewed  and  the  popular  literature  deemed 
to  be  important.  It  is  not  an  exhaustive  listing  of 
all  those  personal  characteristics  which  may  play 
an  important  role  in  determining  who  is  a combat 
effective  pilot.  As  can  be  seen  in  Figure  3.6-3, 
most  of  the  pilots  responding  to  our  questionnaire 
rated  all  of  these  personal  characteristics  as  being 
important,  very  important,  or  critical  for  success 
in  combat.  Approximately  85%  of  the  pilots  answer- 
ing this  questionnaire  rated  desire  to  achieve. 
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aggressiveness,  and  determination  as  being  criti- 
cal or  very  important  personal  characteristics. 

The  factors  of  courage,  initiative  and  willingness 
to  take  calculated  risks  were  rated  critical  and 
very  important  by  almost  as  many  pilots.  Initia- 
tive, leadership,  physiological  stress  tolerance, 
psychological  stress  tolerance,  and  anxiety  toler- 
ance all  received  relatively  low  ratings,  with 
respect  to  the  other  five  personality  characteris- 
tics. However,  it  should  be  pointed  out  that  all 
characteristics  listed  were  considered  tobe  impor- 
tant; some  simply  were  rated  as  more  important  than 
others  in  the  opinion  of  the  pilots  polled.  The 
pilot  input  with  respect  to  the  relative  importance 
of  these  personal  characteristics  will  be  used  in 
Section  4 as  one  of  the  ways  of  determining  which 
characteristics  are  important  in  the  combat  effec- 
tive pilot  profile. 

3.6.4  Ratings  of  the  Importance  of  Critical 
Combat  Pilot  Skills  - Data  on  the  relative  impor- 
tance of  a number  of  combat  skills  were  also  ob- 
tained from  the  Pilot  Effectiveness  Questionnaire. 

A preliminary  task  analysis  of  air-to-air  combat, 
interviews  with  a number  of  pilots,  and  the  inputs 
from  trained  pilot  psychologists  yielded  a list  of 
nine  critical  skills  and  abilities  which  would  be 
required  of  the  effective  fighter  pilot.  The 
pilots  receiving  the  questionnaire  were  asked  to 
rank  the  top  five  of  these  skills  and  abilities 
according  to  their  relative  contribution  to  success 
in  combat,  A list  of  these  nine  skills  and  abili- 
ties and  a score  reflecting  the  median  ranking 
obtained  from  the  pilots  returning  the  question- 
naires are  presented  in  Figure  3.6-4.'  In  the 
figure,  a score  of  five  corresponds  to  a median 


'A  median  rating,  as  used  in  Figure  3.6-4,  is 
calculated  as  in  the  following  example.  If  "Judge 
when  to  shoot"  had  been  ranked  by  five  persons  and 
the  rankings  were  4th,  5th,  3rd,  5th,  and  5th  most 
Important,  the  corresponding  rating  scores  would  be 
2,  1,  3,  1,  and  1.  If  these  scores  are  then 
rearranged  so  they  are  in  ascending  order  (1,1, 

1,  2,  and  3)  and  the  middle  score  (1)  is  selected, 
this  would  be  the  median  rating  from  this  set  of 
scores. 


I 

* 


i 
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STATEMENT:  CERTAIN  FLYING,  PERCEPTUAL  AND  JUDGMENTAL  SKILLS/ 
ABILITIES  DISTINGUISH  EFFECTIVE  FROM  NON-EFFECTIVE  FIGHTER  PILOTS. 
AS  A PROVEN  EFFECTIVE  PILOT  WE  WOULD  LIKE  YOU  TO  HELP  IDENTIFY 
WHICH  SKILLS/ABILITIES  YOU  FEEL  WERE  MOST  IMPORTANT  IN  ACHIEVING 
COMBAT  KILLS.  FROM  THE  LIST  BELOW  CHOOSE  THE  FIVE  (5)  SKILLS/ 
ABILITIES  THAT  IN  YOUR  JUDGMENT  CONTRIBUTED  MOST  TO  YOUR  SUCCESS 
AND  RATE  THEM  IN  ORDER  OF  IMPORTANCE. 

MEDIAN 

ABILITY  TO:  RATINGS* 

1.  OBTAIN  EARLY  VISUAL  TARGET  ACQUISITIOH.  5 _ 

2.  PERCEIVE/JUDGE  TARGET  DIRECTION  AND  RATE  OF  TURN,  _1 

ASPECT  ANGLE,  ANGLE  OFF.  TRACK  CROSSING  ANGLE, 

RANGE,  CLOSING  RATE,  TRACK  CROSSING  RATE. 

3.  KEEP  TRACK  OF  YOUR  CRITICAL  FLIGHT  PARAMETERS  0 - 
(AIRSPEED,  ALTITUDE,  ATTITUDE,  ANGLE  OF  ATTACK, 

“G”) 

4.  SELECT  AND  EXECUTE  THE  BEST  MANEUVER  TO  GAIN  ._L— 

A FIRING  POSITION  (LEAD/LAG  PURSUIT.  YO  YO,  BARREL 

ROLL,  ETC.). 

5.  JUDGE  WHEN  TO  SHOOT.  _J 

6.  SHOOT  WELL  (BOTH  TRACKING  , OR  RAKING  SHOT  WHEN  _a 

TRACKING  WAS  IMPOSSIBLE). 

7.  HANDLE  THE  THROTTLE(S)  AND  SPEEDBRAKE  (MANAGE  _J1 

ENERGY). 

8.  KEEP  TRACK  OF  THE  OTHER  GUYS  - YOUR  WINGMAN,  _1 

OTHER  HOSTILES. 

9.  JUDGE  WHEN  TO  LEAVE  THE  FIGHT.  _D — 

Id.  OTHER  -II — 

•THE  HIGHER  THE  RATING  VALUE  THE  MORE  IMPORTANT  THE 
SKILL  A ZERO  RATING  MEANS  IT  WAS  NOT  SELECTED  AS  IN 
THE  TOP  FIVE  BY  OVER  ONE-HALF  OF  THE  PILOTS  RESPONDING. 

FIGURE  3.6-4  MEDIAN  RATINGS  OF  CRITICAL  COMBAT 
PILOT  SKILLS 


ranking  of  first  place  and  a score  of  one  corres- 
ponds to  a fifth  place  median  ranking.  The  five 
skills  and  abilities  which  have  a nonzero  median 
rating  were  chosen  by  more  than  half  of  the  pilots 
as  being  among  the  five  most  important  skills  or 
abilities  for  air-to-air  combat  effectiveness. 

The  most  surprising  result  of  this  set  of 
ratings  was  the  fact  that  a perceptual  ability, 
and  not  a flying  skill,  appeared  to  be  the  most 
important  single  determiner  of  achieving  combat 
effectiveness.  This  perceptual  skill,  "Obtaining 
early  visual  target  acquisition,"  received  the 
highest  possible  rating  in  over  half  of  the  cases. 
Next  in  importance  was  the  ability  to  select  and 
execute  the  best  maneuver  to  gain  a firing  posi- 
tion. Following  this  were:  The  ability  to  per- 

ceive and  judge  target  direction;  rate  of  turn  and 
aspect  angle  and  other  flight  parameters;  judging 
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when  to  shoot;  and  keeping  track  of  the  other  par- 
ticipants in  the  engagement  - your  wingman  and/or 
other  hostiles.  Factors  such  as:  Keeping  track 

of  the  critical  flight  parameters:  shooting  well; 
managing  energy;  and  judging  when  to  leave  the 
fight  were  not  considered  important  enough  to  be 
rated  amont  the  top  five  by  over  half  of  the  pilots 
returning  the  questionnaire.  While  these  skills 
and  abilities  are  important  to  the  overall  outcome 
of  a combat  engagement,  they  are  not  as  important 
as  the  other  characteristics  listed.  Like  the 
ratings  of  aces  listed  in  subsection  3.6.3,  the 
skills  and  abilities  identified  as  being  critically 
important  in  this  section  will  be  used  as  inputs 
for  our  development  of  the  combat  effective  pilot 
profile. 

3.6.5  Summary  - Pilot  inputs  arising  from 
three  sources,  the  popular  literature,  narrative 
comments  by  aces,  and  questionnaire  responses  from 
373  fighter  pilots,  were  evaluated.  Additionally, 
a representative  sample  of  pilot  comments  was 
presented. 

Although  anecdotal  in  nature,  the  popular 
literature  provided  a background  for  the  comments 
from  the  aces.  An  analysis  of  comments  made  by  the 
aces  yielded  30  descriptors  which  included  aggres- 
siveness, visual  ability,  self-confidence,  risk- 
taking ability,  and  leadership.  (The  complete  list 
appears  in  Figure  3.6-2.)  Two  questions  from  the 
Pilot  Effectiveness  Quesionnaire  provided  informa- 
tion on  the  personal  attributes  and  critical  skills 
required  for  effective  air-to-air  combat  performance. 
The  pilots  sampled  rated  desire  to  achieve,  aggres- 
siveness, and  determination  as  the  most  critical 
personal  attributes.  They  overwhelmingly  rated 
ability  to  obtain  early  visual  target  acquisition 
as  the  most  important  pilot  skill  factor  for  air- 
to-air  effectiveness. 
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4.0  PROFILE  OF  THE  COMBAT  EFFECTIVE  PILOT 

Figure  4.0-1  presents  a suitmary  of  information 
that  was  reviewed  in  Sections  3.2  through  3.fi  re- 
garding the  critical  attributes  of  the  combat 
effective.  Predictors  were  grouped  into  12  major 
domains  with  53  subcategories  or  factors.!  Inputs 
to  this  matrix  were  developed  from  five  sources: 

From  Section  3.2  - Scientific  studies  related 
to  aviation  combat  using  both  objective 
(e.g.,  number  of  kills)  and  subjective 
(e.g.,  peer  and  supervisor  ratings)  measures. 

From  Section  3.3  - Scientific  studies  related 
to  nonaviation  combat  (primarily  infantry) 
using  subjective  (e.g.,  peer  and  supervisor 
ratings)  measures. 

From  Section  3.4  - Scientific  studies  related 
to  success  in  aviation  training  using  a pass- 
fail  criterion. 

From  Section  3.5  - Reports  of  foreign  aviation 
selection  programs. 

From  Section  3.F.  - Analysis  of  pilot  opinions 
drawn  from  our  specially  developed  Pilot 
Effectiveness  Questionnaire. 

Using  these  sources,  each  of  the  51  factors 
were  rated  with  respect  to  their  relative  impor- 
tance for  selection.  With  the  first  three  sources, 
these  ratings  were  principally  based  upon  the  mag- 
nitude of  the  highest  correlation  reported.  Pre- 
dictors (factors)  were  rated  as  Unimportant  (X)  if 
the  highest  correlation  was  below  .15,  Important 
(XX)  if  the  highest  correlation  was  between  .15 
and  .39,  and  Very  Important  (XXX)  if  the  highest 
correlation  was  .40  or  above.  These  cutoffs  are 
arbitrary,  but  serve  to  group  the  empirical  data 
into  three  interpretable  categories. 

Ratings  derived  from  the  foreign  selection 
data  were  based  upon  the  frequency  of  predictor 
usage  and  the  importance  placed  upon  predictors  in 
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the  current  Israeli  program  as  well  as  in  the  World 
War  II  Japanese  and  German  programs.  Ratings  de- 
rived from  pilot  opinions  were  based  upon  the  re- 
sponses of  100  or  more  fighter  pilots  to  three 
questions  from  the  Pilot  Effectiveness  Quesionnaire. 
Two  of  the  questions  required  pilots  to  rank  predic- 
tors with  respect  to  their  relative  importance  for 
the  selection  of  fighter  pilots.  The  third  involved 
pilot  responses  to  an  open-ended  question  concerning 
the  qualities  of  an  ace. 


In  the  last  column  of  Figure  4.0-1  is  a summary 
of  the  current  United  States  Air  Force  (USAF)  selec- 
tion program.  Checkmarks  indicate  the  characteris- 
tics and  critical  skills  which  are  used  as  the  basis 
for  selection  tests  for  entrance  into  undergraduate 
pilot  training  (UPT).  These  decisions  are  based 
upon  our  own  assessment  of  the  selection  routine, 
including  a detailed  review  of  the  AFOQT. 

This  matrix  is  used  to  generate  hypotheses 
regarding  the  characteristics  and  critical  skills 
of  the  combat  effective  pilot  which  are  discussed 
in  subsections.  With  this  goal  in  mind,  the  12 
domains  were  subdivided  into  two  categories  (see 
Figure  4.0-1).  This  subdivision  was  primarily 
based  upon  three  factors: 

a.  How  frequently  predictors  within  each 
domain  were  validated  against  combat 
criteria. 

b.  The  quality  of  the  combat  validation 
studies  within  each  domain. 

c.  The  strength  of  relationship  between 
the  predictors  within  each  domain  and 
combat  criteria. 


'We  realize  that,  in  some  cases,  the  factors 
listed  in  Figure  4.0-1  appear  to  be  overlapping 
(e.g.,  performance  under  stress  and  ability  to  with- 
stand psychological  stress).  If  the  next  phase  of 
this  program  is  implemented,  factors  which  cannot 
be  operationally  distinguished  will  be  grouped. 
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AVIATION 

NONAVIATION 

AVIATION 

COMBAT 

COMBAT 

TRAINING 

CHARACTERISTICS  AND  CRITICAL  SKILLS 

OBJECTIVE 

MEASURES 

SUBJECTIVE 

MEASURES 

SUBJECTIVE 

MEASURES 

PASS- 

FAIL 

BIOGRAPHIC  DATA 

• LIFE  mVENFORY 

• ACADEMIC  HISTORY 

• MILITARY  HISTORY 

• MILITARY  RANK 


RISK  TAKING 

• WILLINGNESS  TO  TAKE  CALCULATED  RISK 


REACTIONS  TO  STRESS 

• PERFORMANCE  UNDER  STRESS 

• EMOTIONAL  CONTROL 

• ABILITY  TO  WITHSTAND  PSYCHOLOGICAL  STRESS 

• ANXIETY  TOLERANCE 

SENSORY  MOTOR  ABILITIES 

• VISUAL 

• MOTOR  COORDINATION 

• SPATIAL  ORIENTATION 

• SPATIAL  PERCEPTUAL  ABILITY 

• PERCEPTUAL  SPEED 


APTITUDE 

• PILOT  COMPOSITES 

• NON  PILOT  COMPOSITES 

• GENERAL  APTITUDE  (INTELLIGENCE) 

• NUMERICAL  SKILLS 

• VERBAL  SKILLS 

• MECHANICAL  SKILLS 

• FLIGHT  APTITUDE 


PERSONALITY 

• AGRESSIVENESS 

• CONFIDENCE 

• MENTAL  HEALTH 

• CONSIDERATION  FOR  OTHERS 

• PERSONALITY  STYLE 

• COURAGE 


PERSONALITY  - LEADERSHIP 

• RESPONSIBILITY  FOR  MEN  IN  COMBAT 

• PHYSICAL  AND  COMBAT  LEADERSHIP 

• ADMINISTRATIVE  SKILLS 

• MILITARY  BEARING 


SOCIAL  FACTORS 

• TEAMWORK 

• SOCIABILITY 

• GROUP  LOYALTY 

• INTERPERSONAL  RATING 


MOTIVATION 

• OETERMINATION/DESIRE 

• SELF  DISCIPLINE 

• SATISFACTION 


MEOICAL/PHYSIOLOGICAL 

• GOOD  PHYSICAL  HEALTH 

• ENDURANCE 

• PHYSICAL  APTITUDE 

• ABILITY  TO  WITHSTAND  PHYSIOLOGICAL  STRESS 


DECISION  MAKING/INFQRMATION  PROCESSING 

• SELECTIVE  AHENTION 

• DECISION  TIME 

• (QUALITY  OF  COMBAT  DECISIONS 

• ALERTNESS 

• INTEGRATIVE  DECISIONS 


AVIATOR  SKILLS.  KNOWLEDGES.  AND  TASKS 

• EQUIPMENT  KNOWLEDGE 

• FLIGHT  SKILLS 

• INSTRUMENT  READING 

• AERIAL  GUNNERY 


FIGURE  4.0-1  A SUMMARY  OF  CHARACTERISTICS  AND  CRITICAL  SKILLS  FOR  THE  COMBAT  EFFECTIVE.  THESE  DATA 
ARE  USED  TO  GENERATE  HYPOTHESES  REGARDING  THE  CRITICAL  ATTRIBUTES  OF  THE  COMBAT  EFFECTIVE  FIGHTER 
PILOT. 
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Five  of  the  domains  contain  predictors  which 
have  been  preliminarily  validated  against  combat 
criteria  (Biographical  Data;  Risk  Taking;  Reactions 
to  Stress;  Sensory-Motor  Abilities;  and  Aptitude). 
These  domains  are  discussed  in  Section  4.1.  As 
shown  in  Figure  4.0-1,  many  of  these  predictors 
have  been  validated  against  success  in  training. 

An  implicit  assumption  in  this  research  is  that 
there  is  a high  degree  of  relatedness  between  suc- 
cess in  training  and  success  in  combat.  However, 
this  assumption  need  not  hold  (see  Section  3.2.1). 
Therefore,  hypothesis  construction  in  these  five 
domains  is  based  upon  combat  research  and  not 
training  research. 

The  other  seven  domains  contain  predictors 
which  have  been  identified  from  aviation  training 
research,  foreign  selection  policy,  and  pilot  opin- 
ion (Personality,  Personal i ty-Leadersiiip,  Social 
Factors,  Motivation,  Medical/Physiological,  Deci- 
sion Making/Information  Processing;  and  Aviator 
Skills,  Knowledges,  and  Tasks).  These  domains  are 
discussed  in  Section  4.2.  Since  these  predictors 
have  not  been  adequately  validated  against  combat 
criteria,  aviation  training  research  is  drawn  upon 
for  hypothesis  construction  when  available. 

In  subdividing  these  domains,  it  is  not  our 
intent  to  imply  that  predictors  within  these  two 
domain  categories  differ  with  respect  to  their 
potential  value  for  the  prediction  of  the  combat 
effective  pilot.  A distinction  of  this  type  would 
be  faulty  since  many  of  the  predictors  which  have 
not  been  studied  in  the  combat  situation  present 
challenging  measurement  problems. 

4 . 1 CHARACTERISTICS  AND  CRITICAL  SKILLS  WITH 
DEMONSTRATED  VALIDITY  IN  COMBAT  SITUATIONS 

4.1.1  Biographical  Data  - "Biographical  data" 
is  a special  domain  in  that  it  is  not  really  a 
characteristic  but  reflects  historical  information 
about  this  individual  as  well  as  constant  biograph- 
ical facts.  A characteristic  tested  at  the  actual 
time  of  pilot  selection  would  be  categorized  as 
that  characteristic;  but  earlier  or  historical 
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manifestations  of  that  characteristic  noted  at  the 
time  of  selection  would  be  treated  as  biographical 
data.  For  example,  information  on  childhood  aggres- 
siveness provides  biographical  data  whereas  aggres- 
siveness, £££  «,  is  a personality  characteristic 
and  will  be  discussed  in  subsection  4.2.1. 

For  the  present  purposes,  biographical  data 
tend  to  be  of  three  basic  types,  life  inventory, 
academic  history,  and  military  history.  Various 
classes  of  biographical  data  have  been  shown  to  be 
related  to  combat  effectiveness  in  both  aviation 
and  nonaviation  settings.  Studying  the  combat 
effectiveness  of  infantrymen  with  disciplinary 
problems,  Dubuisson  and  Klieger  (1964)  found  that 
a personal  inventory  predicted  combat  ratings  of 
effectiveness  fairly  well.  Looking  at  infantrymen 
in  Korea,  Willemin  and  Karcher  (1958)  found  that  a 
classification  inventory  was  predictive  of  combat 
ratings. 

General  or  global  scales  from  biographical 
inventories  and  biographical  data  blanks  have  not 
shown  particularly  strong  relationships  in  aviation 
combat  studies  (Jenkins,  Ewart  and  Carroll,  19511; 
Torrance,  Rush,  Kohn,  and  Doughty.  1957;  Lepley, 
1947),  but  specific  scales  from  those  biographical 
questionnaires  have  yielded  data  suggesting  that 
this  approach  is  extremely  valuable.  Specific  fac- 
tors, including  independence  training,  family  mov- 
ing, parental  control,  and  childhood  aggressiveness, 
emerged  as  related  to  combat  kills  in  the  Strawbridge 
and  Kahn  (1955)  and  Torrance,  et  a^,  (1957)  studies. 
It  appears  that  if  the  right  life  inventory  questions 
are  asked,  the  prediction  of  combat  effectiveness 
may  be  quite  good. 

Academic  history  questions  also  appear  to  be 
related  to  combat  effectiveness  Grades  and  class 
standing  at  '.Jest  Point  have  been  shown  to  oe 
related  to  combat  performance  ratings  (King,  Camp- 
bell, Johnson,  Klieger,  and  Yaukey,  1952).  Simi- 
larly, DCS  grades  have  correlated  with  Officer 
Efficiency  Reports  given  for  combat  service  (Katter 
and  Holmon,  1955).  Selected  military  history  items, 
particularly  flying  hours  in  various  types  of  planes. 
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have  been  shown  to  be  related,  in  varying  degrees, 
to  combat  flying  performance  (Torrance,  et  al,  1957; 
Strawbridge  and  Kahn,  1955). 

In  general,  biographical  data  have  been  shown 
to  be  related  to  combat  effectiveness.  This  is  in- 
terpreted as  a demonstration  of  selection  test  poten- 
tial for  this  class  of  predictor  variable.  Indeed, 
the  present  writers  were  so  convinced  of  the  poten- 
tial of  life  inventory  data  as  one  tool  for  predict- 
ing combat  effectiveness  that  the  Pilot  Life  Inven- 
tory Questionnaire  (Short  Form)  was  developed  and 
administered  to  hundreds  of  pilots  in  a preliminary 
questionnaire  refinement  effort.^ 

Scientific  studies  of  combat  effectiveness 
confirm  the  potential  utility  of  biographical  data 
for  predicting  combat  effective  fighter  pilots. 

Also,  pilot  opinion  and  use  in  foreign  selection 
programs  suggest  that  this  is  a fruitful  domain  for 
further  development.  Two  brief  sections  of  the 
AFOQT  include  biographical  data,  but  tiiere  is  room 
for  substantial  expansion.  After  all,  the  AFOQT 
has  been  validated  on  training  performance,  not  on 
combat  performance. 

4.1.2  Risk  Taking  - Risk  taking  behavior  was 
studied  by  Torrance  and  Ziller  (1957).  They  found 
that  a specially  devised  risk  scale  correlated 
positively  with  two  measures.  Test  Risk  and  Per- 
ceived Risk,  taken  in  a combat  surrogate,  survival 
school,  environment.  The  development  of  the  risk 
scale  came  after  statistically  significant  rela- 
tionships between  a life  inventory  risk  scale  and 
combat  success  (becoming  an  ace)  had  been  shown 
(Torrance,  et  1957).  It  should  be  noted  here 
that  even  though  very  strong  relationships  between 
risk  taking  and  certain  criteriCi.  measures  have 
been  shown,  only  a limited  and  possibly  inadequate 
testing  approach  (paper-and-pencil  testing)  has 
been  used.  Pilot  opinion  has  strongly  supported 
risk  taking  as  critical,  and  this  characteristic 
is  currently  only  indirectly  tested  for  in  the 
USAF  pilot  selection  program  through  methods  such 
as  questions  about  automobile  driving  behavior. 

Risk  taking,  as  a behavioral  characteristic. 


appears  very  important  and  should  be  more  thoroughly 
explored. 

4.1.3  Reactions  to  Stress  - Evidence  from 
observations  of  performance  in  stressful  situations 
suggests  that  differences  in  handling  stress  might 
prove  to  be  important  for  distinguishing  between 
good  and  poor  pilots.  Conclusions  of  a participant 
observer  indicate  that  performance  in  stressful 
situations  undoubtedly  can  be  used  as  a measuring 
dimension  (Peres,  1959).  Strawbridge  and  Kahn 
(1955)  found  that  performance  on  an  aiming  stress 
test  correlated  well  with  objective  aviation  combat 
criteria.  Additionally,  Roff  (1950)  found,  and  it 
was  no  surprise,  that  good  pilots  were  described 
as  having  greater  tolerance  for  stress  than  poorer 
pilots  when  aviators  were  asked  at  the  end  of  a 
combat  tour  to  describe  other  pilots. 

A different  aspect  of  the  stress  reaction 
domain  is  emotional  control.  Torrance,  et  al , 

(1957)  noted  that  a significant  difference  exists 
in  the  amount  of  emotional  reaction  expressed 
during  combat  encounters  when  aces'  and  nonaces' 
self  reports  were  compared.  Aces  showed  less 
emotion. 

In  addition  to  the  indications  from  the  combat 
and  combat  surrogate  studies,  pilots  we  surveyed 
strongly  supported  positive  reactions  to  stress  as 
a component  of  any  accurate  profile  of  the  combat 
effective  aviator.  Also,  descriptions  of  the 
Israeli  pilot  selection  program  suggest  that  this 
is  an  important  domain.  Clearly,  further  investi- 
gation of  the  relationship  between  reactions  to 
stress  and  combat  performance  is  warranted. 


^A  description  of  the  development  and  preliminary 
results  from  the  Pilot  Life  Inventory  Questionnaire 
(Short  Form)  is  given  in  Section  5. 
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4.1.4  Sensory-Motor  Abilities  - Several  dimen- 
sions of  sensory-motor  abilities  have  been  evaluated 
in  aviation  combat  studies  and  shown  to  be  of  value 
in  predicting  superior  aviators.  Motor  coordination 
(tests  of  two  hand  coordination,  finger  dexterity, 
rudder  control,  complex  coordination,  and  rotary 
pursuit  performance)  was  shown  to  correlate  with 
World  War  II  measures  of  combat  performance  includ- 
ing ratings  of  flying  proficiency,  completion  of  a 
combat  tour,  and  several  bombing  accuracy  measures 
(Lepley,  1947).  Selected  coordination  measures, 
most  notably  rotary  pursuit  performance,  were 
positively  correlated  with  combat  kills  in  two 
Korean  War  Studies  (Strawbridge  and  Kahn,  1955; 
Torrance,  et  1957). 

Spatial  orientation  measures  demonstrated  a 
strong  relationship  with  completing  a fighter  pilot 
combat  tour  but  only  a very  weak  relationship  with 
other  combat  measures  taken  in  World  War  II  (Lepley, 
1947).  In  the  same  research  effort,  reaction  time 
and  other  perceptual  speed  measures  were  useful  for 
predicting  some  measures  of  bomber  crew  performance. 

Relationships  between  perceptual- motor  perfor- 
mance and  rated  performance  from  infantry  combat  and 
combat  surrogate  settings  suggests  that  this  cate- 
gory of  variable  is  important  for  other  combat  roles 
as  well  as  that  of  the  pilot  (e.g.,  Willemin  and 
Karcher,  1958). 

During  World  War  II,  and  for  some  years  after 
that,  the  USAF  employed  psychomotor  testing  as  part 
of  its  selection  program,  but  for  several  reasons, 
including  the  difficulties  associated  with  test 
administration  and  equipment  calibration  in 
multiple  locations,  this  was  given  up.  Recently 
efforts  have  been  made  in  the  direction  of 
developing  psychomotor  (McGrevy  and  Valen- 
tine, 1974;  Sanders,  Valentine  and  McGrevy,  1971) 
and  information  processing  tests  (Pew  and  Adams, 
1975)  for  pilot  selection.  Nevertheless,  the  USAF 
selection  program  does  not,  at  present,  include 
this  sort  of  testing,  even  for  the  prediction  of 
success  in  flight  training. 
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Foreign  selection  programs  and  pilot  opinion 
strongly  endorse  the  predictive  potential  of  tests 
of  sensory-motor  abilities.  In  light  of  encouraging 
scientific  data  and  the  widespread  belief  that 
pilots  require  an  above  average  level  of  sensory- 
motor  ability,  the  importance  of  work  to  develop 
and  validate  tests  in  this  domain  (against  ACMR  and 
combat  performance)  is  self-evident. 


4.1.5  Aptitude  - Aptitudes  have  been  success- 
fully used  to  predict  objective  measures  of  aviation 
combat  success.  For  our  purposes,  the  aptitude 
testing  domain  is  defined  broadly  so  as  to  include 
intelligence  tests  and  composites,  e.g.,  stanines. 

Pilot  stanine  scores  were  related  to  retention 
in  the  fighter  pilot  program  and  to  bombing  accuracy 
in  World  War  II  (Lepley,  1947).  In  Korea,  these 
scores  were  related  to  combat  kills  in  the  sample  of 
fighter  pilots  studied  by  Torrance,  e^  aj^,  (1957). 

In  contrast  to  this,  Strawbridge  and  Kahn  (1955) 
obtained  a .00  correlation  between  pilot  stanine 
and  number  of  kills  in  their  Korean  sample. 


Aptitude  tests  for  military  roles  other  than 
that  of  the  pilot  have  also  been  evaluated.  Sta- 
nines of  other  aviator  special ites  (e.g.,  bombardier, 
navigator)  yielded  less  conclusive  results  than 
would  be  expected  when  administered  to  pilots.  The 
value  of  special  job  area  aptitude  tests  for  non- 
flying combatants  was  supported  by  the  results  of 
the  Army  Personnel  Research  Branch  findings  which 
related  aptitude  area  scores  to  combat  aptitude 
ratings  and  rated  combat  performance  (e.g.,  Willemin, 
Rosenberg,  and  White,  1957;  Birnbaum,  White,  Rosen- 
berg, and  Willemin,  1957). 


General  aptitude  and  intelligence  tests  were 
valuable  in  the  Korean  HumRRO  work  (Egbert,  Meeland, 
Cline,  Forgy,  Spickler,  and  Brown,  1957),  and  a 
general  information  test  was  significantly  corre- 
lated with  the  number  of  combat  kills  in  a study  of 
Korean  aviators  (Strawbridge  and  Kahn,  1955).  The 
traditional  verbal  and  numerical  aptitude  areas  have 
been  useful  for  selecting  pilots.  Numerical  operations 
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tests  and  reading  comprehension  tests  were  Inversely 
related  to  objective  criteria  of  combat  success  in 
World  War  II  and  in  the  Korean  War  (Lepley,  1947; 
Torrance,  et  1957).  Scores  on  a mechanical 
aptitude  test  were  positively  related  to  the  number 
of  kills  in  Korea  (Torrance,  et  1957). 

Pilot  opinion  did  not  strongly  support  aptitude 
testing  for  selecting  pilots.  Despite  this,  a very 
strong  case  for  the  use  of  aptitude  tests  exists. 
Undoubtedly,  general  and  special  aptitude  tests  can 
be  improved,  but  moderately  strong  devices  are  cur- 
rently available  and  are  being  used  in  the  present 
USAF  selection  program.  Because  of  the  broad  based 
scientific  support  for  aptitude  testing,  it  seems 
imperative  that  it  be  included  in  the  next  genera- 
tion of  pilot  selection  instruments. 
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4 . 2 CHARACTERISTICS  AND  CRITICAL  SKILLS  IDENTIFIED 
FROM  AVIATION  TRAINING  RESEARCH.  FOREIGN  SELECTION 
POLICY.  AND  PILOT  OPINION 

4.2.1  Personality  - Six  major  types  of  vari- 
ables were  identified  in  this  domain.  These  are 
aggressiveness,  self-confidence,  mental  health, 
consideration  for  others,  personality  style,  and 
courage.  Of  these  variables,  those  which  seem  to 
show  the  most  potential  for  the  prediction  of  the 
combat  effective  fighter  pilot  are  aggressiveness, 
self-confidence,  courage,  and  personality  style. 

Within  combat-related  research,  measures  of 
adult  aggressiveness  have  not  been  studied.  How- 
ever, childhood  aggressiveness,  which  is  a biograph- 
ical variable  (see  Section  4.1.1).  has  shown  strong 
relationships  with  measures  of  air  superiority.  In 
two  of  the  best  studies  conducted  during  the  Korean 
War,  high  correlations  were  found  between  childhood 
fighting  and  the  number  of  combat  kills  (Torrance, 
et  al,  1957;  Strawbridge  and  Kahn,  1955).  Addi- 

3 

tionally,  fighter  pilots  rated  aggressiveness  as 
among  the  most  critical  characteristics  of  the  com- 
bat effective  air  superiority  fighter  pilot,  and 
this  variable  plays  a major  role  in  foreign  selec- 
tion programs.  The  fact  that  aggressiveness  is  not 
currently  tested  for  in  the  selection  of  military 
aviators  may  reflect  the  fact  that  it  is  difficult 
to  measure  rather  than  the  fact  that  it  is  not 
understood  to  be  an  important  factor  in  combat 
effectiveness."*  Very  careful  consideration  should 
be  given  to  constructing  tests  which  have  the 
potential  for  measuring  this  factor. 

Self-confidence  and  courage  are  two  other 
factors  which  in  our  opinion  should  be  highlighted 
in  developing  an  expanded  fighter  pilot  selection 
program.  We  encountered  no  research  in  pilot  selec- 
tion which  directly  evaluated  these  variables  as 
characteristics  of  the  combat  effective.  However, 
pilots  regarded  these,  especially  self-confidence, 
as  important  for  selection,  and  both  factors  play 
a major  role  in  foreign  selection  programs.  We 
feel  that  a pilot's  confidence  in  his  performance 
in  fighter  aircraft  and  his  courage  should  be 
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important  indicants  of  his  willingness  to  engage 
the  enemy.  Therefore,  some  appropriately  developed 
measures  of  self-confidence  and  courage  in  a selec- 
tion program  seem  justified. 

Personality  style  has  been  studied  somewhat  in 
combat  situations,  and  data  suggest  that  this  vari- 
able is  a potentially  valid  one.  For  example,  in  a 
survey  of  combat  pilots  leaving  Korea,  the  most 
effective  pilots  were  given  personality  descriptors 
such  as  modest,  enthusiastic,  sincere,  and  even- 
tempered  (Roff,  1950).  The  U.S.  Army  Personnel 
Research  Branch  Psychologists  (e.g.,  Willemin  and 
Rosenberg,  1957b)  correlated  responses  on  personal- 
ity tests  with  rated  effectiveness  of  soldiers  in 
Korea  and  found  moderately  high  validity  coefficients. 
Personality  style  is  also  reported  to  be  of  value  in 
predicting  success  in  training.  Trexler  (1969),  for 
example,  found  significantly  lower  ego  identity 
scores  among  failures  than  among  successful  flight 
candidates.  Therefore,  although  pilot  opinion 
regarding  personality  style  is  low  and  foreign 
selection  programs  place  little  importance  on  it, 
empirical  data  are  suggestive  of  its  potential  value 
for  the  prediction  of  combat  effectiveness.  We 
recommend  that  some  measure  of  this  factor  be 
refined  for  use  in  pilot  selection  for  combat 
effectiveness. 

For  somewhat  different  reasons,  mental  health 
and  consideration  for  others  do  not  seem  to  warrant 
any  further  development  or  attention.  Torrance, 

^ (1957)  noted  that  exhibiting  childhood  neu- 

rotic traits  was  inversely  related  to  being  an  ace. 
However,  this  factor  is  a biographical  one  and  not 
a mental  health  variable  ger  se  (see  Section  4.1.1). 
Studies  attempting  to  predict  combat  effectiveness 
have  rarely  addressed  mental  health  in  adults. 


^When  pilots  use  the  word  aggressiveness,  they 
are  apparently  referring  to  a set  of  behaviors 
assoriated  with  attacking  the  enemy,  a behavior  we 
want  to  predict. 

"*This  comment  also  applies  to  other  variables 
discussed  in  this  section.  Another  good  example 
is  courage. 
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However,  when  it  has  been  addressed,  puzzling 
results  are  sometimes  reported.  For  example. 

Sparks  and  Neiss  (1956;  In  Mebane,  1957), 
report  a correlation  of  -.43  between  psychiatric 
ratings  and  ratings  of  combat  effectiveness. 

Although  this  correlation  is  substantial,  it  is  in 
the  wrong  direction.  Coupled  with  this,  pilots 
considered  mental  health  to  be  relatively  unim- 
portant as  a testing  area.  Perhaps  the  latter  is 
influenced  by  the  long  time  presence  of  screening 
for  mental  health  in  the  U.S.  system,  i.e.,  those 
with  "poor  mental  health"  have  been  removed. 
Generally,  it  appears  that  mental  health  is  impor- 
tant for  initially  screening  o^  inappropriate 
persons,  and  the  current  USAF  program  seems  to  be 
adequate  in  this  respect,  particularly  if  the 
ARMA  is  used. 

There  is  little  reason  for  recommeding  con- 
sideration for  others  as  a variable  for  a pilot 
selection  program.  Hemphill  and  Sechrest  (1952) 
found  this  factor  important  for  bombing  crews. 
However,  it  seems  that  consideration  for  others 
would  be  more  critical  in  the  bombing  setting  than 
in  the  fighter  plane  setting.  Furthermore,  pilots 
rated  this  factor  as  relatively  unimportant  for 
selection,  and  foreign  selection  programs  place 
little  importance  upon  it.  Therefore,  consideration 
for  others  is  not  thought  to  be  worthy  of  attention 
in  a combat  effectiveness  selection  program.  Some 
related  factors  are  considered  in  Section  4.2.3 
where  social  factors  are  discussed. 

4.2.2  Personal i ty-Leadershi p - Factors  iden- 
tified within  this  domain  are  responsibility  for 
one's  men  in  combat,  physical  and  combat  leadership, 
administrative  skills,  and  military  bearing.  Al- 
though none  of  these  factors  is  assessed  within 
the  current  USAF  selection  program,'  two  of  these 
seem  to  be  potentially  valid  for  the  prediction  of 
fighter  pilot  combat  performance. 

Responsibility  for  one's  men  in  combat  is 
one  of  these  two  factors.  Roff  (1950)  found  that 
pilots  leaving  Korea  rated  responsibility  as  a 
characteristic  of  the  best  fighter  pilots.  Comple- 


menting this  is  the  pilot  opinion  in  our  study, 
i.e.,  responsibility  for  subordinates  in  combat 
was  rated  as  relatively  important  for  fighter  pilot 
selection. 

The  second  personality-leadership  factor 
which  merits  attention  is  physical  and  combat 
leadership.  This  factor  does  not  play  a major 
role  in  foreign  selection  programs  and  showed  low 
correlations  with  nonflying  officer  behaviors  in 
an  Army  study  (Helme  and  Grafton,  1975).  However, 
physical  and  combat  leadership  was  rated  as  a rela- 
tively important  characteristic  by  the  fighter 
pilots.  In  view  of  this  pilot  opinion  and  the 
absence  of  any  negative  evidence  from  aviation 
combat  research,  we  recommend  that  this  factor  be 
considered  in  a pilot  selection  program. 

Administrative  skills  and  military  bearing  seem 
to  show  little  promise  as  predictors  of  success  in 
combat.  Administrative  skills  were  found  to  be 
related  to  nonflying  officer  behavior  in  an  Army 
study  (Helme  and  Grafton,  1975),  and  fighter  pilots 
leaving  Korea  rated  these  skills  as  characteristics 
of  the  best  fighter  pilots.  However,  pilots  we 
questioned  considered  administrative  skills  to  be 
unimportant  for  selection.  In  addition,  these 
skills  are  only  infrequently  assessed  in  foreign 
selection  programs  and  appear  to  have  little  face 
validity  for  the  selection  of  the  combat  effective. 

Military  bearing  rarely  showed  a meaningful 
relationship  to  measures  of  combat  performance. 
Hemphill  and  Sechrest  (1952)  found  a relatively 
high  correlation  between  military  bearing  and  peer 
nominations  for  bomber  crew  performance.  However, 
this  factor  (measured  by  Officer  Quality)  showed 
little  relationship  to  the  number  of  combat  kills 
in  Korea  in  two  studies  (Strawbridge  and  Kahn, 

1955;  Torrance,  ^ al^,  1957),  and  little  relation- 
ship to  staff  performance  in  a simulated  combat. 

environment  (Helme  and  Grafton.  1975J.  In  addition, 
pilots  rated  military  bearing  as  relatively  unimpor- 
tant for  selection.  Therefore,  as  with  administra- 
tive skills,  this  factor  is  also  considered  to  be  of 
little  value  for  pilot  selection. 
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4.2.3  Social  Factors  - Four  types  of  social 
factors  have  been  evaluated.  These  are  teamwork, 
sociability,  group  loyalty,  and  interpersonal  rat- 
ings. Although  none  of  these  factors  is  currently 
assessed  within  the  USAF  selection  system,  three 
seem  to  merit  attention. 

Of  the  social  factors  considered,  interpersonal 
ratings  seem  to  be  the  most  valid  for  the  prediction 
of  combat  effectiveness.  Army  sponsored  research 
has  demonstrated  that  peer  and  supervisor  evalua- 
tions are  highly  useful  both  as  predictors  of  and 
assessments  of  combat  performance  (Egbert,  et  aj[, 
1957;  King,  et  a^,  1952).  These  ratings  have  also 
been  effective  in  predicting  success  in  training. 
Fleischman,  Ambler,  Peterson,  and  Lane  (1966)  found 
a significant  correlation  between  peer  ratings  and 
pass-fail.  Similarly,  Waag  and  Shannon  (1972) 
reported  relatively  high  correlations  between  four 
instructor  ratings  and  pass-fail.  Therefore, 
although  pilot  opinion  is  low  and  little  attention 
is  given  to  these  ratings  in  foreign  selection  pro- 
grams, empirical  data  lead  us  to  conclude  that 
interpersonal  ratings  should  be  seriously  consid- 
ered as  a factor  in  a pilot  selection  battery. 

Aviation  combat  research  suggests  that  team- 
work is  a valid  predictor  of  combat  effectiveness. 
Hemphill  and  Sechrest  (1952)  related  this  predictor 
to  both  bombing  accuracy  and  peer  ratings  in  combat 
and  found  strong  relationships.  Admittedly,  the 
bomber  environment  and  fighter  environment  are  dif- 
ferent, but  teamwork  seems  integral  (although  in  a 
different  manner)  to  both.  Furthermore,  pilots 
noted  this  factor  as  a relatively  important  charac- 
teristic of  the  fighter  pilot.  Consequently,  the 
development  of  a test  for  teamwork  seems  justified. 
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often  assessed  in  foreign  selection  programs.  In 
view  of  the  empirical  data  and  foreign  selection 
policy,  this  factor  is  recommended  for  inclusion 
in  a pilot  selection  program. 

Group  loyalty  does  not  seem  to  warrant  any 
additional  attention  as  a predictor  of  combat 
effectiveness.  Edgerton  and  Graham  (1951)  studied 
the  descriptors  assigned  to  927  good  and  poor  in- 
fantrymen in  Korea.  Of  12  descriptors  in  the  group 
loyalty  category  (e.g.,  helps  others,  stuck  with 
me),  only  one  (thoughtful  of  others)  noticeably 
differentiated  good  from  poor  infantrymen.  Al- 
though pilots  rated  group  loyalty  as  a relatively 
important  characteristic  of  the  fighter  pilot, 
foreign  selection  programs  place  little  emphasis 
upon  this  factor.  Therefore,  empirical  data  and 
foreign  selection  policy  seem  to  indicate  that 
group  loyalty  is  not  an  efficient  predictor  of 
combat  effectiveness. 

4.2.4  Motivation  - Of  the  three  types  of 
motivation  factors  which  have  been  studied  (deter- 
mination/desire, self-discipline,  and  satisfaction), 
determination  seems  to  be  the  most  critical  for 
combat  effectiveness.  This  position  is  supported 
by  high  ratings  derived  from  three  sources  of 
input.  Torrance,  et  (1957)  specifically  note 
that  more  aces  had  made  special  efforts  to  become 
fighter  pilots  than  nonaces.  Complementing  this 
is  the  finding  that  pilots  rated  determination  as 
highly  important  for  selection  and  the  fact  that 
determination  plays  a major  role  in  foreign  selec- 
tion programs.  Since  all  sources  available  con- 
sidered this  factor  to  be  a critical  one,  we  recom- 
mend that  a determination  measure  be  included  in  a 
pilot  selection  program. 


Both  aviation  and  nonaviation  research  indicate 
that  sociability  has  potential  value  for  the  selec- 
tion of  the  combat  effective.  This  factor  showed 
relatively  strong  relationships  to  the  number  of 
kills  in  Korea  (Strawbridge  and  Kahn,  1955),  and 
to  several  measures  in  a specially  designed  stress 
environment  (Meeland,  Egbert,  and  Miller,  1957). 
Although  pilot  opinion  of  it  is  low,  sociability  is 
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Relationships  between  self-discipline  and  com- 
bat performance  have  been  moderately  high.  For 
example,  Roff  (1950)  found  that  effective  Korean 
fighter  pilots  were  characterized  by  greater  con- 
sistency of  effort  than  were  less  effective  pilots. 
Similarly,  aces  were  reported  to  have  less  time  on 
their  hands  than  nonaces  (Torrance,  e^  1957). 
Additional  support  is  provided  by  pilot  opinion 
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and  foreign  selection  policy.  Ratings  derived  from 
both  sources  of  input  were  relatively  high.  In  con- 
clusion, we  feel  that  self-discipl ine  should  also 
be  a factor  in  a pilot  selection  program. 

Relationships  between  satisfaction  (e.g., 
interests,  job  satisfaction)  and  combat  performance 
have  also  been  fairly  strong.  Special  interest  in 
combat-related  activities  correlated  moderately 
well  with  staff  performance  and  leadership  ratings 
in  a simulated  combat  environment  (Helme  and  Grafton, 
1975).  Roff  (1950)  found  that  effective  Korean 
fighter  pilots  were  more  frequently  characterized 
by  enthusiasm  than  were  less  effective  pilots. 
Similarly,  aces  were  reported  to  be  more  enthusias- 
tic about  competition  and  made  more  special  attempts 
to  fly  fighter  planes  than  nonaces  (Torrance,  et 
1957).  In  some  cases,  moderately  high  correlations 
have  also  been  found  when  interests  were  related  to 
success  in  training.  For  example,  Valentine  (1961) 
reported  substantial  correlations  between  two  AFOQT 
interest  scores  (Flying  Interest  and  Technical 
Interest)  and  pass-fail  in  primary  training.  How- 
ever, correlations  with  pass-fail  in  basic  training 
were  low  indicating  that  these  particular  interest 
measures  may  have  limited  potential.  Therefore, 
even  though  ratings  derived  from  pilot  opinion  and 
foreign  selection  policy  were  low,  empirical  data 
support  the  conclusion  that  satisfaction  measures 
are  potentially  valid  for  the  prediction  of  combat 
effectiveness.  Although  the  AFOQT  contains  several 
interest  measures,  training  data  indicate  that 
further  refinements  are  desirable. 

4.2.5  Hedical/Physioloqical  - Physical  health 
is  assessed  in  both  foreign  selection  programs 
and  in  the  USAF  system.  We  encountered  no  combat 
or  training  research  which  evaluated  this  factor, 
and  pilots  regarded  improvements  in  this  area  of 
selection  as  unnecessary.  The  latter  could  be  in- 
fluenced by  the  presence  of  screening  for  physical 
health  in  the  United  States  military,  i.e.,  those 
with  "poor  physical  health"  are  eliminated.  There, 
fore,  it  appears  that  physical  health  is  important 
for  initially  screening  out  unhealthy  individuals, 
and  the  USAF  system  seems  adequate  in  this  respect. 
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Of  the  remaining  types  of  factors  within  this 
domain  (endurance,  physical  aptitude,  and  ability 

to  withstand  physiological  stress),  only  ability  to 

\ 

withstand  physiological  stress  seems  to  warrant 
serious  consideration.  We  found  no  combat  research 
which  evaluated  this  factor,  and  training  data  are 
disappointing.  For  example.  Ambler  and  Guedry 
(1968)  related  responses  to  a Brief  Vestibular  Dis- 
orientation Test  (rotating  chair)  to  pass-fail  in 
training.  Although  the  correlation  was  statisti- 
cally significant,  it  was  quite  low  (r  = .14). 
Additionally,  foreign  selection  programs  place 
little  importance  upon  this  factor.  However,  we 
still  feel  that  measurement  of  physiological  stress 
reactions  is  justified,  i.e.,  it  seems  that  ability 
to  withstand  physiological  stress  should  be  related 
to  fighter  pilot  effectiveness.  Pilots  we  questioned 
appear  to  agree  since  they  rated  this  factor  as  im- 
portant for  selection,  lo  tne  aosence  of  any  dis- 
confirming  evidence  from  combat  research,  we  re- 
commend that  physiological  stress  tes’s  be  included 
in  a pilot  selection  program. 

There  is  little  reason  for  reconinp  idinq  the 
inclusion  of  endurance  and  physical  aptitude  tests 
per  se  in  the  USAF  selection  program  ^ Although 
both  of  these  factors  are  assessed  in  foreign  '.elec- 
tion programs  and  pilots  considered  eno jrance  to  be 
important  for  selection,  neither  has  demupstrated 
validity.  Helme  and  Grafton  (1975)  found  that  t-'flur- 
ance  was  unrelated  to  staff  performance  and  leader- 
ship ratings  in  a simulated  combat  environment.  Simi- 
larly, physical  fitness  is  reported  to  he  uncorre- 
lated with  success  in  combat  (Willemin  and  Rosenberg, 
1957)  and  with  success  in  training  (Valentine,  1361). 
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4.2.6  Decision  Hakinq/lnformation  Processing  - 
Factors  which  can  be  reasonably  classed  under  a 
decision  making/ informat  ion  processing  domain  have 


not  been  adequately  evaluated  in  aviation  combat 
settings.  Choice  reaction  time  measures  were  taken 


^However,  endurance  tests  in  particular  and 
physical  aptitude  tests  with  an  endurance  com- 
ponent might  well  be  recommended  as  tests  for 
determinati on. 
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in  the  World  War  II  program,  but  strong  predictive 
value  was  not  substantiated.  Lepley  (1947)  found 
only  nonsignificant  correlations  between  "reading 
and  judgment"  skill  and  ratings  of  overall  effec- 
tiveness. Similarly,  Korean  War  researchers  failed 
to  find  a relationship  between  "judgment"  and  objec- 
tive measures  of  combat  effectiveness  (Strawbridge 
and  Kahn,  1955;  Torrance,  1957).  Information 

processing  theories  have  developed  substantially 
since  the  early  1950s;  this  has  been  accompanied  by 
considerable  research  on  decision  making  (related 
to  both  speeded  decisions  and  deliberate  decisions). 
This  is  partly  an  outgrowth  of  the  interest  gener- 
ated in  applied  psychology  during  World  War  II. 
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High  quality,  fast  combat  decision  making  was 
cited  by  pilots  questioned  by  Roff  (1950)  as  a 
characteristic  of  good  pilots.  This  is  consistent 
with  the  high  potential  value  the  pilots  we  ques- 
tioned were  willing  to  assign  to  decision  time, 
selective  attention,  and  quality  of  combat  deci- 
sions. 

J|)St  of  the  support  for  an  expanded  effort  in 
main  of  decision  making/information  processing 
comes  from  pilot  opinion.  This  support,  when  aug- 
mented by  the  recently  improved  theoretical  base 
for  developing  tests  in  this  area,  makes  it  a domain 
worthy  of  further  analysis  and  research. 


A sound  theoretical  and  experimental  base  now 
exists  for  expanding  this  class  of  variable  into 
highly  useful  tests  (see,  for  example,  Broadbent, 
1971;  Kahneman,  1973;  Teichner  and  Krebs,  1974). 

In  conjunction  with  their  review  and  development 
of  motor  skills  tests  pertaining  to  pilot  selec- 
tion, Pew  and  Adams  (1975)  have  examined  some 
information  processing  tests.  This  reflects  a 
growing  interest  in  applying  this  class  of  variable 
to  pilot  selection  for  success  in  pilot  training. 

We  view  it  as  an  important  predictor  of  combat 
success. 

Nonaviation  research  has  looked  at  several 
decision  making/information  processing  factors. 
Support  for  perceptual  speed  studies  is  reported 
with  the  sensory-motor  data.  Several  Army  Person- 
nel Research  Branch  researchers  found  moderate 
relationships  between  reasoning  tests  and  combat 
aptitude  ratings  (Birnbaum,  White,  Rosenberg,  and 
Willemin,  1957a;  Birnbaum,  Rosenberg,  White  and 
Willemin,  1957;  Willemin,  Rosenberg,  and  White, 
1957;  Willemin  and  Rosenberg,  1957).  The  same  rea- 
soning tests  were  compared  with  actual  combat  rat- 
ings, and  a moderate  relationship  was  found 
iWillemin,  Birnbaum,  Rosenberg,  and  White,  1957). 

4 test  of  intelligence  and  alertness  showed  a rela- 

• msnip  with  peer  ratings  in  a study  by  Edgerton 

• <■«**«»-  (1951).  Genera’ly,  nonaviation  combat 

*>4S  indicated  that  decision  making/infor- 

>■»'  ing  is  a valuable  domain. 


4.2.7  Aviator  Skills.  Knowledges,  and  Tasks  - 
Included  in  tiiis  domain  are  predictors  related  to 
equipment  knowledge  (e.g.,  aeronautical  information, 
technical  vocabulary),  flight  skills  (e.g.,  job 
sample  and  light  plane  performance,  visualization 
of  maneuvers) , instrument  reading  (e.g.,  dial  and 
table  reading,  instrument  comprehension),  and  aerial 
gunnery.  Three  of  these  factors  (equipment 
knowledge,  flight  skills,  and  instrument  reading) 
are  assessed  within  the  current  USAF  selection 
program. 

Torrance,  (1957)  found  low  correla- 

tions between  equipment  knowledge  (technical 
vocabulary;  pilot)  and  number  of  kills  in  Korea. 
However,  pilots  leaving  Korea  rated  knowledge  of 
equipment  as  a skill  of  the  best  fighter  pilots 
(P.off,  1950),  a finding  which  is  complemented  by 
pilot  opinion  in  our  study,  i.e.,  fighter  pilots 
considered  this  factor  to  be  highly  important  for 
selection.  Training  data  also  support  the  impor- 
tance of  this  factor.  For  example,  Kaplan  (1965) 
reported  moderately  high  correlations  between 
aeronautical  information  and  the  pass-fail 
cri  terion. 

A similar  pattern  emerges  with  flight  skills, 
Hemphill  and  Sechrest  (1952)  found  little  relation- 
ship between  flight  skills  and  peer  nominations  in 
bombing  crew  performance.  However,  pilots  rated  the 
possession  of  flight  skills  as  an  important  attribute 
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of  the  best  fighter  pilots  in  Korea  (Roff,  1950). 
Similarly,  pilots  we  questioned  considered  flight 
skills  to  be  relatively  important  for  selection. 
Training  data  strongly  suggest  that  this  factor  is 
measurable.  Moderately  high  to  high  correlations 
have  been  found  between  pass-fail  and  flight  grades 
(Flyer  and  Bigbee,  1955b;  Martoccia  and  Nelson, 
1956),  job  sample  performance  (Lemaster  and  Gray, 
1974;  Long  and  Varney,  1975),  light  plane  perfor- 
mance (Berkshire  and  Ambler,  1963;  Flyer  and  Bigbee, 
1955a,  1955b;  Mullins  and  Cox,  1960),  flight  visual- 
ization (Kaplan,  1965),  and  visualization  of  maneu- 
vers (Valentine,  1961),  respectively. 

During  World  War  II,  low  correlations  were 
reported  between  instrument  skills  and  objective 
and  subjective  criteria  with  one  exception.  A 
statistically  significant  negative  correlation  was 
found  between  dial  and  table  reading  and  circular 
error  in  bombing  (Lepley,  1947).  Also  noted  are 
low  and  moderate  relationships  between  instrument 
skills  and  number  of  combat  kills  in  Korea  (Straw- 
bridge  and  Kahn,  1955;  Torrance,  et  1957). 

This  factor  was  also  considered  to  be  unimportant 
by  pilots  we  sampled.  In  contrast,  foreign  selec- 
tion policy  strongly  suggests  measurement  of  instru- 
ment reading  as  does  training  research  (DuBois, 

1947;  Kaplan,  1965;  Valentine,  1961).  For  example, 
‘correlations  of  .34  to  .46  were  reported  between 
instrument  reading  and  pass-fail  during  World  War 
II  (DuBois,  1947). 

Although  few  data  are  available  for  aerial 
gunnery,  both  pilot  opinion  and  foreign  selection 
policy  suggest  that  this  factor  be  included  in  a 
pilot  selection  program. 

In  conclusion,  demonstrated  competence  in  per- 
forming components  of  a complex  task  should  be 
related  to  success  in  performance  of  that  task. 
Aviator  skills,  knowledges,  and  tasks  would, 
all  factors  being  equal,  be  expected  to  be  more 
closely  related  to  aviation  combat  performance 
than  other  classes  of  predictors.  Generally, 
relationships  reported  in  aviation  research  have 
been  weak.  Perhaps  this  is  due  in  part  to  the 


insensitivity  in  the  measuring  devices  used.  In 
contrast,  moderate  to  high  correlations  were  noted 
in  the  training  research,  a finding  which  is  often 
complemented  by  pilot  opinion  and  foreign  selection 
policy.  In  view  of  the  latter  and  the  face  validity 
of  aviator  skills,  knowledges,  and  tasks,  these  mea- 
sures are  judged  to  be  important  for  the  selection 
of  the  combat  effective.  > 
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4.3  SUMMARY  OF  THE  CHARACTERISTICS  AND  CRITICAL 
SKILLS  FOR  THE  PREDICTION  OF  THE  COMBAT  EFFECTIVE 
FIGHTER  PILOT 

In  Sections  4.1  and  4.2,  the  characteristics 
and  critical  skills  which  comprise  a profile  of 
the  combat  effective  fighter  pilot  were  discussed. 
Figure  4.3-1  presents  an  overview  of  these  sections. 

As  can  be  seen  from  the  figure,  six  of  the  51 
factors  were  not  recommended  for  testing.  Of  the 
45  factors  which  were  recommended  for  testing,  ten 
appear  to  be  adequately  tested  within  the  current 
United  States  Air  Force  pilot  selection  program. 

To  select  fighter  pilots  adequately,  the  35  factors 
listed  in  the  last  column  of  this  figure  require 
further  analysis.  These  factors  must  be  exhaustively 
analyzed  and  developed  specifically  for  the  purpose 
of  selecting  the  combat  effective.  Section  7 con- 
tains our  evaluations  of  the  available  testing 
devices  as  they  pertain  to  these  characteristics 
and  critical  skills. 

Prior  to  these  evaluations,  specific  testing 
procedures  which  have  been  more  thoroughly  consid- 
ered are  discussed.  Section  5 presents  the  develop- 
ment of  a paper-and-pencil  life  inventory  question- 
naire which  has  potential  for  selecting  combat 
effective  fighter  pilots.  Section  6 summarizes  the 
state  of  the  art  in  air  combat  simulation.  Both  of 
these  sections  include  information  which  impacts 
the  assessment  of  the  various  testing  domains 
discussed  in  Section  7. 
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CHARACTERISTICS  AND  CRITICAL  SKILLS 


BIOGRAPHICAL  DATA 

• LIFE  INVENTORY 

• ACADEMIC  HISTORY 

• MILITARY  HISTORY 

• MILITARY  RANK 
RSK  TAKING 

• WILLINGNESS  TO  TAKE  CALCUUTEO  RISKS 
REACTIONS  TO  STRESS 

• PERFORMANCE  UNDER  STRESS 

• EMOTIONAL  CONTROL 

• ABILITY  TO  WITHSTAND  PSYCHOLOGICAL  STRESS 

• ANXIETY 

SENSORY-MOTOR  ABILITIES 

• VISUAL  PERCEPTION 

• MOTOR  COORDINATION 

• SPATIAL  OR lENTAflON 

• SPATIAL-PERCEPTUAL  ABILITY 

• PERCEPTUAL  SPEED 
APTITUDE 

• PILOT  COMPOSITES 

• NON-PILOT  COMPOSITES 

• general  APTITUDE  (INTELLIGENCE) 

• NUMERICAL  SKILLS 

• VERBAL  SKILLS 

• MECHANICAL  SKILLS 

• FLIGHT  APTITUDE 
PERSONALITY 

• AGGRESSIVENESS 

• SELF  CONFIDENCE 

• MENTAL  HEALTH 

• CONSDERATION  FOR  OTK^^RS 

• PERSONALITY  STYLE 

• COURAGE 

PERSONALITY  > LEADERSHIP 

• RESPONSIBILITY  FOR  MEN  IN  COMBAT 

• PHYSICAL  AND  COMBAT  LEADERSHIP 

• ADMINISTRATIVE  SKILLS 

• MILITARY  BEARING 
SOCIAL  FACTORS 

• TEAMIORK 

• SOCIABILITY 

• GROUP  LOYALTY 

• INTERPERSONAL  RATING 
MOTIVATION 

• DETERMMATION/DESIRE 

• SELF  DISCIPLINE 

• SATISFACTION 
MEDICALTHYSIOLOGICAL 

• GOOD  PHYSICAL  HEALTH 

• ENDURANCE 

• PHYSICAL  APTITUDE 

• ABILITY  TO  WITHSTAND  PHYSIOLOGICAL  STRESS 
DECISION  MKING/INFORMATION  PROCESSING 

• SELECTIVE  ATTENTION 

• DECISION  TIME 

• QUALITY  OF  COMBAT  DECISIONS 

• ALERTNESS 

• INTEGRATIVE  DECISIONS 

AVIATOR  SKILLS.  KNOWLEDGES,  AND  TASKS 

• EQUIPMENT  KNOWLEDGE 

• FLIGHT  SKILLS 

• INSTRUMENT  READING 

• AERIAL  GUNNERY 


FIGURE  4.H  AN  OVERVIEW  OF  CHARACTERISTICS  AND 
CRITICAL  SKILLS  FOR  THE  PREDICTION  OF  THE  COMBAT 
EFFECTIVE  FIGHTER  PILOT 
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5.0  DEVELOPMENT  AND  ANALYSIS  OF  THE 
PILOT  LIFE  INVENTORY  QUESTIONNAIRE 


A special  paper-and-penci 1 selection  device, 
the  Pilot  Life  Inventory  Questionnaire,  is  being 
developed.  This  potential  selection  device  has 
been  administered  to  most  of  the  pilots  who  com- 
pleted the  Pilot  Effectiveness  Questionnaire  dis- 
cussed in  Section  2.  The  present  section  focuses 
upon  the  development  and  preliminary  validation 
efforts  associated  with  the  Pilot  Life  Inventory 
Questionnaire. 

5.1  QUESTIONNAIRE  RATIONALE 

Paper-and-penci 1 testing  has  been  an  accepted 
component  of  most  selection  batteries  for  years. 

In  many  cases,  tests  devised  for  other  purposes, 
such  as  determining  personality  or  intelligence, 

have  been  used  as  part  of  a selection  package. 

On  the  other  hand,  specially  contrived  tests  have 
proven  to  be  very  useful  for  selecting  individuals 
for  highly  specialized  poisitions  (Anastasi,  1976). 
There  has  been  a scarcity  of  tests  specially  devised 
for  selecting  the  combat  effective.  Our  research 
has  failed  to  identify  a single  test  of  combat 
effectiveness  that  has  been  adequately  validated. 
Only  one  specially  contrived  test  has  been  identi- 
fied, and  that  one  was  developed  over  twenty  years 
ago  (Torrance,  1954). 

As  part  of  his  study,  Torrance  (1954)  con- 
trasted the  paper-and-penci 1 responses  of  a group 
of  27  Korean  War  aces  and  near  aces  with  a matched 
group  of  27  nonaces.  A surprising  difference  in 
"efforts  to  obtain  combat  assignments"  was  found 
(see  Figure  5.1-lA).'  Even  more  dramatic  differ- 
ences were  found  when  self-reported  childhood  ag- 
gressiveness was  examined  (see  Figure  5.1-lB). 

These  data  reinforced  our  conviction  that  paper- 
and-penci  1 tests  by  themselves  offer  a potentially 
effective  selection  tool,  albeit  one  whose  princi- 
pal power  is  limited  primarily  to  certain  personal 
factors. 

To  examine  our  hypothesis  that  these  personal 
factors  could  be  evaluated,  and  to  determine  the 


77  ACES  AND 
NEAR  ACES 

DRIFTED  INTD 
THE  PROGRAM 

7 

MADE  SOME 
SPECIAL  EFFORT 

9 

MADE  REPEATED 
SPECIAL  EFFORTS 

U 

77 

NONACES 


FIGURE  5.1-U  EFFORTS  TO  OBTAIN  COMBAT  ASSIGNMENT 


77  ACES  OR 

77  MATCHED 

NEAR  ACES 

NONACES 

N0N4GGRESSNE 
FEW  OR  NO  FIGHTS 

0 

1 

USUAL  AGGRESSIVENESS 
USUAL  NUMBER  FIGHTS 

S 

16 

VERY  AGGRESSIVE 
MANY  FIGHTS 

71 

3 

FIGURE  5.1-lB  CHILDHOOD  AGGRESSIVENESS 

FIGURE  5.1-1  SAMPLE  OF  DISCRIMINATING  QUESTIONNAIRE 
ITEMS  (Torrance,  1954) 


feasibility  of  using  a paper-and-penci 1 test  for 
revealing  individual  differences  among  fighter 
pilots,  two  goals  were  sought.  First,  we  sought 
to  demonstrate  that  we  could  develop  an  instrument 
sensitive  to  individual  differences;  and  second, 
we  sought  to  determine,  in  a preliminary  manner, 
whether  differences  along  specified  criterion  di- 
mensions could  be  isolated.  Both  goals  were 
accomplished. 

5 . 2  QUESTIQNNAIRE  DEVELOPMENT  - PRELIMINARY  F0RJ1 
A new  instrument,  the  Pilot  Life  Inventory 
Questionnaire,  was  developed  incorporating  features 
of  the  Torrance  (1954)  test,  but  adapted  to  the  air- 
craft and  social  milieu  of  the  mid-1970s.  To  accom- 
plish this,  we  turned  to  a general  profile  of  the 
combat  effective  pilot.  This  profile  was  generated 
from  a collection  of  approximately  100  personal 


’It  should  be  kept  in  mind  that  these  data  as 
well  as  those  in  Figure  5.1 -IB  were  taken  after 
the  pilots  had  become  aces. 
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factors  which  emerged  from  a preliminary  literature  i 

review.^  These  personal  factors  were  grouped  into 
the  12  major  categories  shown  in  Figure  5.2-1.^  We 
expected  quantitative  or  qualitative  differences 
between  combat  effective  and  combat  ineffective  i 

pilots  on  these  characteristics.  The  preliminary  I 

literature  review  and  an  evaluation  of  various  i 

standard  tests  confirmed  the  potential  value  of  i 

these  categories  and  revealed  "independence"  as  an 
additional  personality  characteristic  to  be  eval-  , 

uated.  General  personality  testing  has  shown  that 
these  categories  could  be  sampled,  but  sampling 
them  for  the  specific  purpose  of  selecting  combat 
effective  pilots  is  a relatively  unexplored  area, 
greatly  limiting  the  souVces  of  items  for  our  I 

questionnaire.  I 
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5.3  QUESTIONNAIRE  ITEM  DEVELOPMENT 
FORM 


PRELIMINARY 


We  attempted  to  identify  questions  which  would 
reveal  the  independence  factor  and  the  character- 
istics listed  in  Figure  5.2-1.  In  doing  this,  we 
placed  more  emphasis  on,  and  developed  mere  test 
items  for,  categories  we  felt  could  best  be  eval- 
uated with  paper-and-pencil  tests.  Although  prece- 
dent exists  for  the  categories  selected,  there  was 
no  predisposition  to  identify  a predictive  factor 
for  each.  Instead,  these  were  stimuli  for  item 
development.  Concepts  such  as  personality  and 
aggressiveness  do  not  lend  themselves  to  tight  def- 
inition and,  indeed,  are  fraught  with  added  meaning. 
With  this  in  mind,  we  were  not  particularly  con- 
cerned with  category  overlap. 

Test  questions  used  by  Torrance  (1954)  were 
classified  according  to  the  13  categories  (12  cate- 
gories listed  in  Figure  5.2-1  plus  the  independence 
category).  The  item  analysis  of  the  life  experience 
inventory  provided  by  Torrance  was  reviewed  as  was 
his  later  report  (Torrance,  Rush,  Kohn,  and  Doughty, 
1957)  which  reported  results  of  administering  the 
Inventory.  In  light  of  this  information,  the  items 
from  the  life  experience  inventory  were  individually 
evaluated.  If  they  appeared  to  have  predictive 
value,  they  were  updated  for  inclusion  in  the 
questionnaire.  Rewriting  ranged  from  slight 
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modification  in  wording  to  the  development  of  a 
completely  new  question  based  on  the  same  theme. 

The  Edwards  Personal  Preference  Schedule  and 
other  standardized  personality  tests  (e.g.,  the 
Minnesota  Multiphasic  Personality  Inventory) 
were  also  reviewed  for  test  themes.  These  themes 
were  the  stimuli  for  questions,  but  in  no  case  was 
an  item  from  these  tests  used  or  modified  as  was 
done  with  items  from  the  Torrance  life  experience 
inventory. 

In  addition,  questions  were  developed  to  tap 
specific  personality  or  interest  areas  which  had 
been  designated  either  by  a panel  of  McDonnell 
Douglas  Corporation  fighter  pilots  or  by  our  re- 
search personnel.  These  were  sorted  into  the  13 
categories.  Figure  5.3-1  shows  the  category  and 
general  source  of  the  majority  of  questions  used 
(Questions  1-120).“*  The  approach  to  each  category 
is  briefly  outlined  below. 

General  Intelligence  - No  attempt  was  made  in 
this  inventory  to  assess  general  intelligence, si  nee 
military  records  include  scores  on  conventional 
psychological  tests  of  this  class. 

Physical  Health  - No  attempt  was  made  to 
assess  physical  health  except  for  a single  question 
in  which  the  individual  gives  his  own  general  im- 
pression of  his  health. 5 Physical  health  can  be 
evaluated  from  conventional  medical  records. 

Mental  Health  - As  a general  conclusion,  the 
combat  effective  will  be  in  a state  of  good  mental 
health.  Operating  on  the  assumption  that  conven- 
tional pilot  selection  devices  screen  for  mental 


^Subsequently,  we  completed  an  extensive  liter- 
ature search.  This  literature  is  reviewed  in 
Sections  3.2  through  3. 4. and  the  resulting  profile 
is  presented  in  Section  4.0 

^The  development  of  the  preliminary  Pilot  Life 
Inventory  Questionnaire  preceded  the  analysis  of 
characteristics  which  appears  in  Section  4.0 

“*Twenty-one  questions  (Questions  121-141)  were 
questions  about  famous  fighter  pilots. 

^Combat  Ineffective  personnel  perceive  them- 
selves to  be  in  poor  physical  health. 
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GENERAL  INTELLIGENCE 

• COMPREHENSION 

• ABSTRACT  REASONING 

• QUICK  LEARNING 

• KNOWLEDGE 

• AWARENESS  MILITARY  SITUATION 

• ABILITY  TO  COWmUNICATE 

• MECHANICAL  COMPREHENSION 

• MECHANICAL  ABILITY 

PHYSICAL  HEALTH 

• STAMINA 

• VIGOR 

• STURDINESS 

• ENERGY 

• FITNESS 

MENTAL  HEALTH 

• MENTAL  STABILITY 

• EMOTIONAL  ADJUSTMENT 

• EMOTIONAL  STABILITY 

• EMOTIONAL  MATURITY 

• PSYCHOLOGICAL  SOUNDNESS 

• MANIFEST  ANXIETY 

• PSYCHOLOGICAL  HEALTH 
« EMOTIONAL  CONTROL  ' 

• ADJUSTIVE  SKILLS 

• PEER  ACCEPTANCE  AND  RESPECT 

• SOCIAL  ADJUSTMENT  AND  PARTICIPATION 
. AOAPTABLE/FLEXIBLE 

LIFE  INVENTORY 

• BIRTH  ORDER 

• AGE 

• EARLY  INDEPENDENCE  TRAINING 

• TESTING  THE  LIMITS  OF  BEHAVIOR  (BREAKING  THE  RULES) 

• EARLY  PARENTAL  CONTROL 

• STABLE  HOME  LIFE  WITH  STRONG  AFFECTIONAL  TIES  WITH  PARENTS 

• MORE  FORMAL  SCHOOLING 

• PARENTAL  STRIVING 

• HIGHER  SOCIOECONOMIC  LEVEL 

• POSITIVE  FAMILY  AFFECT 

NEGATIVE  CORRELATIONS 

• CHILDHOOD  NEURDTIC  BEHAVIORS 

• ILLNESS  PATTERNS 

• PSYCHIATRIC  HISTORY 

• DISCIPLINARY  RECORDS 

RISK  TAKING  BEHAVIOR 

• RISK  AND  STRATEGY 

• DESIRE  FOR  VARIED  EXPERIENCE 

• TAKING  CALCULATED  RISKS 

• STIMULUS  ADDITIVE  - EXTEND  TO  PHYSICAL,  EMOTIONAL  OR  INTELLEC- 
TUAL LIMITS 

• WILLINGNESS  TO  TAKE  CONSEQUENCES  OF  THEIR  OWN  BEHAVIOR 

• LONERS 

• FORTHRIGHTNESS 

• RESOURCEFULNESS 

• NONCONFORMITY 

• REJECTION/HONCONFORMITY  SOCIAL  STANDARDS 


PERSONALITY  * ' 

• EGO  STRENGTH 

• STRONG  SENSE  REALITY 

• WILL  TO  DOMINATE 

• INTENSE  INDIVIDUALITY 

• DESIRE  FOR  SUCCESS/RECOGNITION 

• ALERTNESS 

• MASCULINITY 

• DOER  SYNDROME 

• SELF-RESPECT 

• SELF-ASSERTIVENESS 

• SOCIAL  RESPONSIBILITY 

• CHEERFULNESS 

• INGENUITY 

• FORCEFULNESS 

• COMMAND  PRESENCE 

• CAPACITY  FOR  TEAMWORK 

• IN-GROUP-MINDEDNESS 

GENERAL  MOTIVATION 

• DRIVE 

• ZEAL  FOR  FLYING 

• MOTIVATION  FOR  COMBAT 

• STRIVING  FOR  SUCCESS 

• DRIVE  IN  FACE  OF  HARDSHIP 

• ACHIEVEMENT  MOTIVATION 

AGGRESSIVENESS 

• PHYSICAL  AGGRESSIVENESS 

• PERSONAL  AGGRESSIVENESS 

• DISPLAYED  AGGRESSIVENESS  AND  INITIATIVE 

DETERMINATION 

• INDIVIDUAL  DETERMINATION 

• PERSISTENCE 

• SELF-OISCIPLINE 

• IRON  WILL 

COURAGE 

• PERSONAL  COURAGE 

• THE  BRAVE  HEART 

• FEARLESS,  BRAVE.  GUTS 

STRESS  BEHAVIOR 

• EFFICIENCY  UNDER  STRESS 

• EMOTIONAL  STABILITY  UNDER  STRESS 

• TAKE  CRISES  IN  STRIDE 

LEADERSHIP 

• CAPACITY  FOR  LEADERSHIP 

• LEADERSHIP  POTENTIAL 

• LEADERSHIP  SYNDROME 

• LEADERSHIP  OF  STRUCTURED  AND  LEADERLESS  GROUPS 

• LEADERSHIP  ABILITY  AND  PRACTICES 


•THESE  PERSONAL  FACTORS  WERE  OERIVED  FROM  A PRELIMINARY 
LITERATURE  REVIEW. 


FIGURE  5.2-1  PRELIMINARY  PROFILE  OF  PERSONAL  FACTORS  RELATED  TO  COMBAT  EFFECTIVENESS* 
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1 SOURCE  OF  QUESTION  THEME* 

o 

ITEM 

NO. 

CATEGORY 

UJ 

o 

ae 

t/> 

o 

QC 

a S S 

s 

q: 

o 

o 

UJ 

OTHER 

STANOi 

TESTS 

PILOT 

PANEL 

1 o 2 s 

iisi 

CATEGORY 


1 LEADERSHIP 

2 AGGRESSIVE- 

NESS 

3 LIFE  INVEN- 

TORY 

4 DETERMINA- 

TION 

5 AGGRESSIVE- 

NESS 

6 ACHIEVEMENT 

7 PERSONALITY 

8 MENTAL 

HEALTH 

9 ACHIEVEMENT 

10  PERSONALITY 

11  AGGRESSIVE- 

NESS 

12  PERSONALITY 

13  COURAGE 
U AGGRESSIVE- 
NESS 

19  INDEPENDENCE 

16  INDEPENDENCE 

17  INDEPENDENCE 

18  LEADERSHIP 

19  LIFE  INVEN- 

TORY 

20  INDEPENDENCE 

21  INDEPENDENCE 

22  INDEPENDENCE 

23  RISK  TAKING 

24  AGGRESSIVE- 

NESS 

29  STRESS 

26  ACHIEVEMENT 

27  COURAGE 

28  COURAGE 

29  DETERMINATION 

30  AGGRESSIVE-  X 

NESS 

31  AGGRESSIVE-  X 

NESS 

32  PERSONALITY  X 

33  STRESS  X 

34  PERSONALITY  X 

39  AGGRESSIVE-  X 

NESS 

36  LEADERSHIP  X 

37  LEADERSHIP  X - 

38  INDEPENDENCE  X 

39  PERSONALITY  X 

•GENERAL  IDEAS  WERE  USED  AS  STIMULI  FOR  QUESTIONS,  BUT  NO  ITEMS 
OR  MODIFIED  ITEMS  FROM  EXISTING  TESTS  WERE  USED  EXCEPT  FOR  SOME 
FROM  THE  TORRANCE  LIFE  EXPERIENCE  INVENTORY. 

FIGURE  5.3-1  TEST  ITEM  CATEGORIES  AND  SOURCES 


1 SOURCE  OF  QUESTION  THEME’ 

TORRANCE 

EDWARDS 

OTHER 

STANDARDIZED 

TESTS 

PILOT 

PANEL 

MDAC-EAST 

RESEARCH 

PERSONNEL 

40 

PERSONALITY 

41 

PERSONALITY 

42 

PERSONALITY 

43 

PERSONALITY 

44 

ACHIEVEMENT 

49 

ACHIEVEMENT 

4« 

INDEPENDENCE 

47 

INDEPENDENCE 

48 

INDEPENDENCE 

49 

INDEPENDENCE 

SO 

INDEPENDENCE 

FIGURE  5.3-1  TEST  ITEM  CATEGORIES  AND  SOURCES 
(Continued) 

health  and  eliminate  those  who  are  not  of  "good" 
mental  health,  only  a few  items  were  created  for 
this  category. 

Life  Inventory  - Life  inventory  data  have  been 
useful  in  selecting  out  people  who  are  a burden  to 
the  system.  Torance,  al_,  (1957)  noted  that  cer- 
tain life  inventory  items  showed  high  correlations 
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ITEM 

NO. 

CATEGORY 

SOURCE  OF  QUESTION  THEME*  | 

TORRANCE 

EDWARDS 

OTHER 

STANDARDIZED 

TESTS 

PILOT  PANEL 

MOAC-EAST 

RESEARCH 

PERSONNEL 

83 

LIFE  INVENTORY 

X 

84 

LIFE  INVENTORY 

X 

85 

PERSONALITY 

X 

86 

RISK  TAKING 

X 

87 

INDEPENDENCE 

X 

88 

ACHIEVEMENT 

X 

89 

RISK  TAKING 

X 

90 

RISK  TAKING 

X 

91 

LIFE  INVENTORY 

X 

92 

MENTAL  HEALTH 

X 

93 

INOEPENDENCE 

X 

94 

INDEPENDENCE 

X 

95 

LIFE  INVENTORY 

X 

96 

LIFE  INVENTORY 

X 

97 

LIFE  INVENTORY 

X 

98 

ACHIEVEMENT 

X 

99 

INDEPENDENCE 

X 

100 

AGGRESSIVENESS 

X 

101 

ACHIEVEMENT 

X 

102 

ACHIEVEMENT 

X 

103 

RISK  TAKING 

X 

104 

STRESS 

X 

105 

DETERMINATION 

X 

106 

LIFE  INVENTORY 

X 

107 

DETERMINATION 

X 

108 

DETERMINATION 

X 

109 

LIFE  INVENTORY 

X 

110 

LIFE  INVENTORY 

X 

111 

PHYSICAL  HEALTH 

X 

112 

LIFE  INVENTORY 

X 

113 

AGGRESSIVENESS 

X 

114 

MENTAL  HEALTH 

X 

115 

LIFE  INVENTORY 

X 

116 

AGGRESSIVENESS 

X 

117 

LIFE  INVENTORY 

X 

118 

LIFE  INVENTORY 

X 

119 

ACHIEVEMENT 

X 

120 

AGGRESSIVENESS 

X 

FIGURE  5.3-1  TEST  ITEM  CATEGORIES  AND  SOURCES 


(Continued) 

with  fighter  pilot  success.  Because  of  this,  some 
of  the  topics  which  were  particularly  useful  for 
Torrance  were  expanded  In  the  present  test,  and 
additional  life  inventory  items  were  added.  Life 
Inventory  infonnation.  In  many  cases,  provides 
Information  for  other  categories.  For  example, 
aggressive  behavior  might  occur  more  often  In  those 
who  fought  as  children.  This  Information  on  fight- 
ing as  a child  could  legitimately  be  classed  under 
personality  or  life  Inventory  data.  Generally, 
then,  the  life  Inventory  class  Is  restricted  to 


biographical  data,  even  though  the  life  inventory 
approach  might  be  used  for  other  categories. 

Risk  Taking  Behavior  - All  fighter  pilots  are 
risk  takers  by  definition,  but  the  Items  included 
in  the  risk  taking  category  provide  specifications 
of  the  degree  of  risk  taking.  Finer  gradations  of 
risk  taking  (particularly  calculated  risk  taking) 
behavior  were  expected  to  have  predictive  value 
for  our  purposes. 

Personality  - A class  of  factors  fall  inn  with- 
in what  is  generally  considered  the  realm  of  per- 
sonality was  Included.  Personality  Is  an  inter- 
vening variable  and,  as  such,  cannot  be  directly  | 

assessed.  Whether  or  not  the  label  is  appropriate  [, 

for  the  factors  involved  is  not  critical.  Of  pri- 
mary  importance  is  whether  or  not  the  questions 
predict.  With  this  In  mind,  the  label  "personality" 

Is  used. 

Achievement  (Motivation)  - Like  personality, 
motivation  Is  not  necessarily  a good  descriptor, 
but  It  may  have  predictive  value.  Aggressiveness 
and  determination,  factors  which  are  generally 
thought  to  correlate  with  motivation,  were  included. 

One  aspect  of  motivation,  achievement,  emerged  from 
our  literature  review  as  Important.  Consequently, 
several  questions  explorinq  achievement  were  also 
used. 

Aggressiveness  - Not  only  is  aggressiveness  a 
common  descriptor  of  combat  effective  individuals, 
but  Torrance,  et  al_«  (1957)  found  it  to  be  highly 
correlated  with  combat  success.  Knowin.  this,  we 
developed  numerous  questions  which  evaluated  this 
salient  characteristic  of  the  combat  effective. 

Determination  and  Courage  - These  common  des- 
criptors of  combat  effective  Individuals  are  prob- 
ably best  evaluated  by  methods  other  than  paper- 
and-pencil  tests.  Because  of  this,  only  a few  test 
items  for  these  categories  were  included. 

Stress  Behavior  - Reactions  to  stress  are  not 
readily  evaluated  by  paper-and-pencll  tests.  Even 
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so.  a few  questions  were  Included  to  assess  the 
individual's  subjective  evaluation  of  his  reactions 
In  stressful  situations.  More  useful  data  are 
expected  to  come  from  specially  contrived  situa- 
tional tests,  similar  to  those  developed  by  the 
Office  of  Strategic  Services  (OSS  Assessment  Staff, 
1948). 

Leadership  - Like  some  of  the  previously  men- 
tioned descriptors,  leadership  potential  is  more 
easily  recognized  in  holistic  testing. 

Independence  - Independence  is  likely  to  be 
revealed  in  various  behaviors  demonstrated  by  a 
youth.  As  such,  some  life  inventory  type  questions 
directly  addressing  this  topic  were  included. 

These  cover  reactions  to  authority  and  factors 
related  to  financial  independence.  Like  aggres- 
siveness, an  independence  factor  was  expected  to 
emerge  as  a major  predictor  of  combat  effective 
fighter  pilots. 

The  resultant  version  of  the  test  was  divided 
into  two  sections.  Both  include  items  generated 
to  provide  data  on  the  various  categories.  Section 
one  includes  many  items  based  principally  on  a 
Likert  scale  type  of  question  relating  to  opposing 
adjectives,  e.g.,  strongly  agree  - strongly  disagree. 
Other  items  in  section  one  require  more  specific 
answers,  but, in  all  cases,  a single  response  is 
required. 

Section  two  includes  questions  with  non-exclu- 
sive alternatives.  Several  answers  are  possible. 

This  is  particularly  efficient  for  obtaining  his- 
torical data  when  many  life  events  may  apply.  The 
separation  of  sections  one  and  two  was  done  primar- 
ily with  the  logistics  of  test  administration  and 
scoring  in  mind.  A simple  answer  sheet  is  used 
where  practicable.  Several  items  in  section  two 
might  require  so  many  responses  as  to  unduly  slow 
the  test  taker.  Because  of  this,  the  answers  go 
directly  on  the  test  paper  even  though  this  creates 
some  additional  work  for  the  test  scorer. 

5.4  QUESTIONNAIRE  DEVELOPMENT  (SHORT  FORM) 

The  preliminary  version  of  the  Pilot  Life 
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Inventory  Questionnaire  was  administered  to  13  pi- 
lot instructors  and  26  student  pilots  at  the  Navy 
Fighter  Weapons  School  at  the  Naval  Air  Station, 
Miramar,  California.  The  instructors  were  highly 
experienced  in  teaching  fighter  tactics,  and  two  of 
the  13  scored  MIG  kills  in  Southeast  Asia.  These 
instructor  pilots  are  thought  to  be  representative 
of  the  highly  skilled  and  combat  tempered  fighter 
pilot,  and,  as  such,  they  were  used  as  a criterion 
group  and  contrasted  with  various  student  groups. 

The  student  pilots  were  themselves  a highly  select 
group  in  that  they  were  all  aircraft  commanders. 
Therefore,  finding  differences  among  groups  within 
this  homogeneous  population  can  be  taken  as  prima 
faci e evidence  of  the  feasibility  of  distinguishing 
among  fighter  pilots. 

An  item  analysis  was  performed  on  the  responses 
of  the  instructors  and  students.  The  purpose  of 
this  analysis  was  to  isolate  those  items  which 
merited  further  study  or  refinement  as  predictors 
of  fighter  pilot  performance.  Our  criteria  for 
item  selection  were  partly  based  upon  phi  correla- 
tion coefficients  computed  for  each  response  alter- 
native on  each  question.®  Ten  criteria  were  used. 
Four  of  these  were  variants  of  instructor  versus 
student  group  membership,  and  six  were  student 
grades  in  Navy  Fighter  Weapons  School.  Further 
descriptions  of  these  criteria  and  the  computed 
phi  coefficients  may  be  found  in  Appendix  5. A. 

The  initial  step  in  item  selection  was  to  re- 
tain those  items  having  the  highest  coefficients. 
From  item  coefficients,  it  is  possible  to  ascer- 
tain which  items  have  predictive  power  and,  with 
careful  evaluation,  which  items  can  be  modified  to 
have  greater  predictive  effectiveness.  Caution  was 
exercised,  however,  since  some  items  could  have 
high  or  low  coefficients  as  a result  of  random 
variation.  Tests  of  significance  were  made  as  an 
aid  in  making  decisions  about  retaining  items. 

The  phi  coefficient  (*)  and  chi  square  (x^)  are 


®The  phi  coefficient  is  a measure  of  the  degree 
of  relationship  between  two  dichotomous  variables. 
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closely  related,  and  it  can  be  shown  that  the 
critical  values  of  ^ for  a test  at  the  .05  and  .01 
levels  are: 


♦.05  " 


1.96 


♦.01 


2.58 


where 

N = the  number  of  individuals  in  the  upper 
criterion  class  plus  the  number  in  the 
lower  criterion  class. 


For  each  of  the  pilot  groupings  and  criterion 
measures  used,  a number  of  phi  coefficients  reached 
statistical  significance.  Ue  reviewed  the  test 
item  phi  coefficients  and  selected  for  further 
analysis  those  items  which  yielded  significant 
values.  Because  of  the  small  sample  of  pilots  per 
group,  their  homogeneity,  and  the  preliminary 
nature  of  this  questionnaire,  it  would  have  been 
premature  to  have  relied  too  heavily  on  these  sta- 
tistics to  select  items  for  further  study,  lie  also 
retained  items  which,  by  inspection,  showed  promise 
of  providing  useful  patterns  of  responses.  Items 
similar  to  those  found  useful  by  Torrance,  et  aXt 
(1957)  were  also  selected  for  further  study  even 
when  our  preliminary  evaluation  yielded  low  phi 
values.  These  items  were  reviewed  and  collected 
into  a revised  "Pilot  Life  Inventory  Questionnaire 
(Short  Form)"  (see  Appendix  5.B). 

5.5  PRELIMINARY  VALIDATION  OF  THE  PILOT  LIFE 
INVENTORY  QUESTIONNAIRE  (SHORT  FORM) 

To  properly  validate  a pilot  selection  device, 
one  ideally  would  administer  the  device  to  a large 
sample  of  pilot  candidates  and  track  them  for  sev- 
eral years  to  see  how  responses  to  certain  items 
correlate  with  demonstrated  combat  performance. 

This  procedure  defines  predictive  validation,  i.e., 
prediction  of  future  performance  (Anastasi,  1968). 

Due  to  time  and  budgetary  restraints,  this  procedure 
was  not  practicable.  However,  some  indication  of  the 
predictive  validity  of  a test  instrument  may  be 
gained  from  a priori  comparisons  of  potential  cri- 
terion groups,  i.e.,  concurrent  validation  (Anastasi, 
1968).  Therefore,  we  performed  this  type  of  vali- 
dation procedure  in  a preliminary  fashion.  Section 
5.5.1  describes  the  groups  which  have  been  sampled. 
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Section  5.5.2  presents  some  a prjorj  comparisons 
from  selected  items  and  a discussion  of  the  data 
limitations  in  this  preliminary  validation  effort. 

5.5.1  Those  Completing  the  Short  Form  - The 
57  item  short  form  was  administered  to  seven  groups 
of  fighter  pilots. 

American  Fighter  Aces  Association  - This  is  an 
association  of  U.S.  pilots  who  have  shot  down  five 
or  more  enemy  aircraft.  Most  of  the  membership 
attained  ace  status  during  either  World  War  II  or 
the  Korean  War.  The  respondents  from  this  group 
include  numerous  notables,  i.e.,  over  two  dozen 
generals  and  admirals.  The  responses  of  this  group 
are  of  special  interest  because  these  men  are  aces. 
The  importance  attributed  to  these  responses,  while 
great,  must  be  tempered  by  the  knowledge  that  most 
of  these  men  became  aces  over  25  years  ago.  The 
present  researchers  are  acutely  sensitive  to  the 
fact  that  reflections  from  the  vantage  point  of 
maturity  might  predispose  a man  to  respond  differ- 
ently than  he  would  have  responded  when  he  was  a 
new  pilot.  We  are  also  aware  of  the  substantial 
change  in  fighter  planes  over  the  past  35  years. 
Nevertheless,  these  American  Fighter  Aces  Associa- 
tion members  are  the  aces,  and  that  makes  their 
responses  unique. 

Navy  MIG  Killers  Association  - This  is  an 
association  of  Navy  pilots  and  crewmen  who  achieved 
a MIG  kill  in  Southeast  Asia.  Most  of  these  men 
are  still  on  flying  status.  They  represent  a more 
contemporary  sample  of  men  with  proven  combat 
capability. 

Red  River  Valley  Fighter  Pilots  Associ ation 
(River  Rats)  - This  is  an  organization  of  pilots 
who  flew  combat  in  the  Red  River  Valley  around  the 
Hanoi  region  in  North  Vietnam.  These  combat 
experienced  pilots  are  representative  of  the  opera- 
tional flying  community. 

A i_r^  Combat  Evaluation  jAJI^V  A L ) - A i r I njt  e rcept 
Missile  Evaluation  (AIMVAL)  Pilots  - This  is  a 
group  of  F-14  and  F-15  crewmen  who  are  currently 
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participating  In  a tactics  and  air  intercept  mis- 
sile evaluation  at  the  Air  Force  Air  Combat  Maneu- 
vering Instrumentation  (ACMI)  facility  at  Nellis 
Air  Force  Base.  These  crews  have  been  carefully 
and  individually  selected  for  this  test  program, 
and  as  such,  they  are  considered  to  be  among  the 
best  in  their  respective  service.  The  Air  Force 
and  Navy  ACEVAL-AIMVAL  participants  are  treated 
separately  and  thus  comprise  two  distinct  groups. 

Aggressor  Squadron  - The  pilots  in  this  unit 
are  highly  trained  in  enemy  tactics  and  fly  as  the 
mock  enemy  for  air  combat  training  conducted  at 
the  ACMI  at  Nellis  Air  Force  Base,  Nevada.  Like 
the  ACEVAL-AIMVAL  crews, these  men  are  very  care- 
fully selected  for  this  assignment. 

National  Guard  Pilots  - This  group  was  included 
because  a substantial  number  of  cockpits  are  filled 
by  Guardsmen  and  Reservists, and, as  such, these  groups 
should  be  sampled.  Pilots  from  the  Air  National 
Guard  unit  at  Lambert  Field,  St.  Louis,  Missouri, 
were  sampled. 

The  groups,  number  of  questionnaires  distrib- 
uted, and  number  of  questionnaires  returned  are 
shown  in  Figure  5.5-1.'^ 


9-1120 


PILOT  ORGANIZATION 

NUMBER 

OSTRIBUTEO 

NUMBER 

RETURNED 

PERCENT 

RETURNED 

AMERICAN  FIGHTER  ACES  ASSOCIATION 

SZ4 

257 

49 

NAVY  MIG  KILLERS  ASSOCIATION 

RED  RIVER  VALLEY  FIGHTER  PILOTS  ASSOCIATION 

42 

22 

52 

(RIVER  RATS) 

99 

51 

51 

NATIONAL  GUARD  PILOTS 

40 

13 

33 

ACEVAL-AIMVAL  NAVY  PILOTS 

12 

12 

100 

ACEVAL-AIMVAL  AIR  FORCE  PILOTS 

6 

6 

100 

AGGRESSOR  SQUADRON  AT  NELLIS 

12 

12 

100 

TOTAL 

735 

373 

51 

FIGURE  5.5-1  summary  OF  RESPONSE  FREQUENCIES  TO 
THE  PILOT  LIFE  INVENTORY  QUESTIONNAIRE  (SHORT 
FORM) 


5.5.2  Preliminary  Comparisons  and  Data 
Analysis  - In  examining  the  concurrent  validity  of 
the  short  form  of  the  Pilot  Life  Inventory 


Questionnaire,  one  potentially  useful  comparison 
is  to  contrast  the  combined  responses  of  the  Navy 
MIG  Killers,  the  Air  Force  and  Navy  ACEVAL-AIMVAL 
pilots,  and  the  members  of  the  Aggressor  Squadron, 
with  those  of  the  River  Rats  (Comparison  1).  This 
constitutes  a comparison  of  groups  ordered  along 
a criterion  dimension  of  fighter  pilot  ability.® 

A comparison  of  the  responses  of  the  members 
of  the  American  Fighter  Aces  Association  with  those 
of  the  River  Rats  (Comparison  2)  is  interesting  but 
confounded  with  age  and  the  accompanying  societal 
differences.  If  it  were  not  for  this  issue,  this 
comparison  would  contrast  aces  with  nonaces.  Never- 
theless, it  can  still  be  a valuable  comparison.  As 
an  aid  to  the  interpretation  of  any  differences 
which  might  be  obtained  in  this  comparison,  it 
would  be  useful  to  contrast  the  best  fighter  pilots 
from  each  era.  Such  a comparison  results  when  the 
responses  of  the  members  of  the  American  Fighter 
Aces  Association  are  contrasted  with  those  of  the 
ACEVAL-AIMVAL  crews,  the  members  of  the  Aggressor 
Squadron,  and  the  Navy  MIG  Killers  combined  (Com- 
parison 3). 

The  groups  being  compared  in  this  sample  com- 
prise a single, rather  homogeneous  sample.  They  are 
alike  in  that,  in  all  cases,  these  men  have  flown 
in  an  operational  setting;  and  by  the  time  fighter 
pilots  are  in  the  operational  environment. they  have 
survived  several  formal  and  informal  screenings. 

It  is,  of  course,  more  difficult  to  get  differences 
between  subsets  of  a homogeneous  group  than  between 
more  disparate  groups.  This  homogeneity  imposes  a 
limitation  on  our  analysis. 


^The  Short  Form  has  also  been  distributed  to  Air 
Force  MIG  Killers  and  a matched  sample  of  Air  Force 
pilots.  The  responses  of  those  samples  will  be 
analyzed  separately  and  reported  elsewhere. 

®We  in  no  way  mean  to  imply  that  the  membership 
of  the  Red  River  Valley  Fighter  Pilots  (River  Rats) 
is  not  a highly  competent  group  of  pilots.  Clearly, 
these  combat  seasoned  men  are  the  backbone  of  the 
current  fighter  pilot  community.  These  men,  as  a 
group,  have  not,  however,  undergone  the  same  review 
as  have  the  Navy  MIG  Killers,  the  ACEVAL-A'MVAL 
pilots,  or  the  Aggressor  Squadron  Pilots. 
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Our  first  attempt  at  direct  comparisons  in- 
volved the  computation  of  the  statistic  phi  for 
each  item  for  each  of  the  comparisons.  For  this 
first  attempt,  excluding  a handful  of  clearly 
nominal  scale  items,  only  one  of  several  possible 
response  distribution  breakpoints  was  used.  For 
example,  if  the  response  alternative  were  strongly 
agree,  agree,  no  opinion,  disagree,  and  strongly 
disagree,  the  responses  in  most  cases  were  dichot- 
omized into  strongly  agree  and  agree  versus  the 
other  three  alternatives.  Of  course,  it  is  possible 
that  dividing  the  distribution  between  strongly 
disagree  and  all  other  alternatives  might  have 
yielded  clearer  results. 

One  method  which  can  be  employed  to  determine 
distribution  break  points  without  introducing  ex 
post  facto  bias  is  to  divide  the  frequency  distri- 
bution of  responses  for  each  item  as  close  as 
possible  to  the  median.  Phi  coefficients  using 
such  breakpoints  were  not  computed.  Instead,  phi 
coefficients  were  computed  with  the  distribution 
divided  according  to  a priori  reasons.  An  example 
of  the  difference  in  results  which  can  be  obtained 
with  the  two  procedures  is  shown  for  item  17  in  a 
comparison  of  the  River  Rats  with  the  combined  group 
of  Navy  MIG  Killers,  ACEVAL-AIMVAL  pilots  and 
Aggressor  pilots.  Item  17  is,  "It  bothers  me  to 
lose  a game, 

1.  Very  much 

2.  Somewhat 

3.  Very  little 

4.  Not  at  all. " 

Our  first  attempt  at  analyzing  this  item  called  for 
a break  between  response  two  and  response  three. 
Dividing  the  distribution  that  way  resulted  in  a 
phi  value  of  0.146.  Breaking  near  the  median  di- 
vided the  group  between  responses  one  and  two  and 
resulted  in  a phi  of  0.199  which  exceeded  0.193, 
the  critical  value  for  significance  at  the  .05 
level.  Of  course,  some  breakpoints  would  not  change, 
and  some  changes  in  the  breakpoint  could  result  in 
diminishing  values  of  phi.  Either  way,  until  the 
more  complete  analysis  is  performed,  the  phi  values 
discussed  here  are  considered  preliminary.  Because 
of  this,  only  a few  selected  items  are  discussed 
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in  detail.  A more  thorough  analysis  has  been  pro- 
posed as  part  of  a continuation  effort. 


Question  28,  which  inquired  about  the  type  of 
work  the  pilots'  fathers  performed,  is  illustrative 
of  a basic  biographical  information  question.  The 
comparison  of  the  River  Rats  with  the  combination 
of  Navy  MIG  Killers,  ACEVAL-AIMVAL  pilots,  and  the 
Aggressor  pilots  showed  that  of  the  River  Rats 
sampled,  15%  had  fathers  who  were  professionals; 
whereas  in  the  combined  group,  38%  of  the  fathers 
were  professionals.  The  associated  phi  value  was 
sufficiently  high  to  be  considered  significant 
[♦(103)  = .234,  p < .05].  A related  finding  is 
that  a greater  percentage  of  the  River  Rats'  fathers 
were  semiskilled  workers  than  in  the  combined  group 
or  the  group  of  American  Fighter  Aces.  The  validity 
coefficients  for  both  comparisons  were  significant 
[♦(103)  = .251,  p < .05  and  ^(294)  = .151,  p < .05, 
respectively]. 

A behavioral  feature  cited  by  Torrance,  et  a^, 
(1957)  as  characteristic  of  superior  fighter  pilots 
was  their  motivation  to  get  into  the  fighter  pro- 
gram. Question  47  directly  addressed  this  issue, 
and  the  preliminary  results  are  consistent  with 
those  of  Torrance,  et  aj^.  Question  47  reads,  "If 
blocked  from  pilot  training  for  minor  physical 
reasons,  such  as  20/25  vision,  color  vision  weak- 
ness, height  or  weight,  I would:  (Check  as  many 

as  apply) 

1 . Accept  the  decision 

2.  Try  to  correct  the  defect  in  an  acceptable 
fashion 

3.  Memorize  the  eye  chart  or  otherwise  fudge 
the  results 

4.  Seek  a waiver 

5.  Use  influence  to  get  an  exception  made." 

The  responses  of  the  River  Rats  differed  from 
those  of  the  combined  group  of  Navy  MIG  Killers, 
Aggressor  pilots,  and  ACEVAL-AIMVAL  pilots. 
Twenty-two  percent  of  the  River  Rats  indicated  that 
they  would  try  to  use  influence,  whereas  40"  of  the 
combined  group  of  pilots  indicated  that  they  would 
seek  a waiver.  The  validity  coefficient  for  this 
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response  alternative  was  statistically  significant 
[${103)  = .205,  p < .05].  Unlike  the  Torrance, 
et  al , (1957)  findings,  the  other  response 
alternatives  were  chosen  almost  equally  frequently 
by  these  groups. 

A difference  between  the  American  Fighter  Aces 
and  both  contemporary  pilot  groups  was  the  differ- 
ence in  the  frequency  of  response  to  alternative  one 
of  Item  47.  A few  (14%)  of  the  American  Fighter 
Aces  indicated  that  they  would  abide  by  the  deci- 
sion. Hardly  any  of  the  contemporary  sample  an- 
swered response  one  (2%).  This  difference  is 
likely  to  be  due  to  cultural  differences  from  the 
1940s  and  195us  to  the  present. 

The  responses  to  Question  40  also  provided 
information  relevant  to  the  hypothesis  considered 
by  Torrance,  ^ aj^,  (1957).  Torrance,  et  al^,  (1957) 
posited  that  superior  fighter  pilots  had  more  child- 
hood fights.  Question  40  is,  "In  fights  that  you 
have  been  in,  were  your  opponents: 

1.  From  the  same  neighborhood  i 

2.  From  across  town 

3.  From  another  town 

4.  This  does  not  apply  since  I never  fought." 
Twenty  percent  of  the  River  Rats,  a random  sample 
of  combat  experienced  pilots,  indicated  response 

4,  whereas  only  four  percent  of  the  group  of  highly 
selected  pilots  (ACEVAL-AIHVAL  pilots.  Aggressor 
pilots,  and  Navy  MIG  Killers)  chose  response  4 
[$(103)  = .215,  p < .05].  This  suggests  that  almost 
all  of  our  sample  of  contemporary  pilots  classed  as 
superior  fighter  pilots  have  shown  aggressiveness 
as  evidenced  in  fighting. 

As  noted  earlier,  without  further  statistical 
analysis,  only  suggestive  comments  can  be  made  with 
regard  to  differential  responding  by  the  various 
pilot  groups.  The  following  emerge  from  our  test 
development  activities  as  reasonable  hypotheses. 
Pilots  with  demonstrated  combat  effectiveness  tend 
to: 

0 Be  frank.  They  will  tell  others  what 
they  think 


0 Be  more  aggressive  as  evidenced  by  fight- 
ing behavior 

0 Be  leaders  in  that  in  group  settings 
others  tend  to  go  along  with  their 
stated  positions 

0 Want  to  do  things  their  way.  They  do 
not  like  losing  games  and  do  not  parti- 
cipate in  activities  for  the  sake  of 
participation 

0 Be  well  adjusted  as  reflected  in  the 
ability  as  children,  to  change  schools 
easily 

0 Be  from  upper  middle  class  social  and 
educational  backgrounds. 

5.6  SUMMARY 

A paper-and-pencil  selection  device,  the  Pilot 
Life  Inventory  Questionnaire  (Short  Form),  has  been 
developed.  Items  for  this  questionnaire  were 
devised  to  sample  personal  factors  in  13  domains 
(life  inventory,  risk-taking,  intelligence,  physi- 
cal health,  mental  health,  personality,  motivation, 
aggressiveness,  determination,  courage,  stress 
reactions,  leadership,  and  independence). 

The  questionnaire  was  administered  to  volun- 
teers from  seven  pilot  groups  (American  Fighter 
Aces  Association,  Navy  MIG  Killers  Association, 

Red  River  Valley  Fighter  Pilots  Association,  Navy 
and  Air  Force  ACEVAL-AIMVAL^  programs.  Air  National 
Guard  (in  St.  Louis,  Missouri)  and  the  Aggressor 
Squadron  at  Nellis  Air  Force  Base).  The  data 
collected  from  these  pilots  were  analyzed  in  a 
preliminary  fashion.  Interim  conclusions  tend  to 
support  the  position  that  effective  fighter  pilots 
are  aggressive,  frank,  well  adjusted,  and  leaders. 
Additional  information  about  fighter  pilots  is 
likely  to  emerge  from  further  multivariate  analyses 
of  the  data. 


'’Documentation  used  in  preparing  this  report 
referred  to  this  program  as  ACEVAL-AIMVAL . For 
consistency,  this  acronym  is  used  throughout  the 
report,  although  the  current  appelation  of  the 
program  is  AIMVAL-ACEVAL. 
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section  6.0 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


MCOOM^ELL  OOUai-AS 


/' 


6.0  EVALUATION  OF  SIMULATORS  AND 
INSTRUMENTED  AIR  COMBAT  MANEUVERING  RANGES 

FOR  THE  SELECTION  OF  COMBAT  EFFECTIVE  PILOTS 

This  section  reviews  --elected  air  combat  simu- 
lators and  instrumented  air  combat  ranges  to  evalu- 
ate their  potential  as  selection  test  beds  for  the 
prediction  of  combat  effectiveness.  This  analysis 
delineates  the  characteristics  of  the  existing 
facilities,  identifies  the  type  of  use  to  which 
they  have  been  put,  and  describes  the  parameters 
analyzed  and  the  pilot  proficiency  measures  used 
to  evaluate  the  results.  Where  adequate  data  are 
available,  the  reliability  and  validity  of  the  per- 
formance measures  were  analyzed  to  determine  whether 
the  data  generated  discriminated  between  pilots. 
Where  possible^  performance  in  the  facilities  was 
checked  against  some  independent  measure  of  flying 
capability.  A brief  summary  of  the  findings  of 
this  section  is  presented  in  Figure  6.0-1. 

6 . 1 AIR  COMBAT  MANEUVERING  SIMULATORS 

Since  1968  a number  of  major  air  combat  maneu- 
vering simulators  have  been  constructed  by  NASA, 
the  military,  and  the  aerospace  industry.  Sparked 
by  the  availability  of  large  capacity  computers 
and  advances  in  electronics  technology,  these 
simulators  have  been  designed  to  include  a real- 
time, full  mission  capability  including,  in  some 
cases,  the  air-to-air  combat  mission.  Their 
primary  purposes  have  been  for  pilot  training  and 
aircraft  design,  as  well  as  for  tactics,  weapons 
systems,  and  avionics  evaluation.  For  the  first 
time,  it  was  possible  to  evaluate  the  ca,nability 
of  new  aircraft  concepts  with  a pi lot-in-the-loop 
system.  This  section  investigates  the  possibility 
that  the  new  generation  of  man- in- the- loop  air 
combat  simulators  can  be  used  as  a tool  to 
evaluate  the  air-to-air  combat  capabilities  of 
pilots.  Should  this  prove  true,  air  combat 
simulation  offers  a new  approach  and  potentially 
powerful  tool  for  selecting  combat  effective 
pilots. 

This  section  reviews  four  major  simulation 
facilities  having  an  interactive  air-to-air  combat 


capability.  These  include;  the  McDonnell  Douglas 
Manned  Air  Combat  Simulator  (MACS)  at  St.  Louis, 
Missouri;  the  Differential  Maneuvering  Simulator 
(DMS)  at  NASA,  Langley.  Virginia;  the  Simulator  for 
Air-to-Air  Combat  (SAAC)  at  Luke  AFB.  Arizona;  and 
the  Advanced  Simulator  for  Undergraduate  Pilot 
Training  (ASUPT)  at  Williams  AFB.  Arizona.  The 
MACS,  DMS.  SAAC  and  ASUPT  are  the  best  combat  simu- 
lators presently  available.  Multiple  visits  were 
made  to  each  of  these  facilities  to  gather  informa- 
tion on  (1)  their  capabilities,  (2)  the  way  in 
which  they  have  been  used,  and  (3)  data  generated 
from  air-to-air  combat  which  could  be  used  to  eval- 
uate their  utility  as  a tool  for  pilot  selection. 

Our  review  found  that  the  MACS  and  the  DMS 
were  capable  of  high  fidelity  air-to-air  combat 
simulations.  Both  the  SAAC  and  the  ASUPT,  which 
were  designed  for  training  purposes,  would  require 
improvements  in  the  out-of-the  window  display,  and 
the  ASUPT  would  require  significant  modifications 
for  inclusion  of  a weapons  system,^  These  systems 
did,  of  course,  show  utility  as  training  devices. 

A number  of  problems  were  identified  in  utili- 
zing simulators  as  selection  tools.  Among  these 
are  the  problem  of  getting  adequate  performance 
measures,  what  these  measures  should  be  (kills, 
time  in  envelop,  or  what?)  and  a general  lack  of 
consistency  in  performance  measures  between  simula- 
tions. A number  of  measurement  and  operational 
innovations  were  noted  which  offer  the  possibility 
of  solutions  to  some  of  these  problems.  Among 
these  are  tne  Adaptive  Maneuvering  Logic  (AML) 
model  developed  by  NASA,  Langley,  which  provides  a 
consistent,  computer-generated  opponent  against 
which  pilots  can  be  evaluated,  and  the  AML  scoring 
system  which  appears  to  provide  a reliable  measure 
of  pilot  proficiency  which  correlates  well  with  the 
ultimate  criterion  - kills.  Overall,  it  appears 

'The  CRT  system  does  not  allow  adequate  defini- 
tion of  the  opponent  aircraft  at  long  range.  This 
eliminates  many  of  the  key  cues  used  in  "antici- 
pating" an  opponent's  maneuvers  which  are  funda- 
mental to  executing  effective  offensive  or  defensive 
countermaneuvers. 
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PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


SIMULATORS 


FACILITY  DESCRIPTION 


MANNED  AIR  COMBAT  SIMULATOR  (MACS) 
MCDONNELL  DOUGLAS.  ST.  LOUIS.  MO. 


STA I E-OF  THE  ART  19M-1972  »ITH  ON  LINE  COMPUTER 
INiERACTIVE  FLIGHT  CAPABILITY  ALLONING  ONE-ON-ONE 
Ik  'HREE-ON-ONE  COMBAT  SIMULATIONS.  SIMULATIONS 
LIMi'^'':  ONLY  BY  AVAILABLE  SOFTWARE  PROGRAMS.  CAN 
USE  ACTIVE  T*0  MAN  COCKPITS.  FOUR  PILOT  STATIONS  - 
TWO  WITH  20  FT  VIRTUAL  IMAGE  SCREEN  - TWO  WITH  40  FT 
PROJECTED  IMAGE  SCREENS.  ACTIVE  HUD.  INSTRUMENTS. 
SOUND  AND  "G"  CUES.  ON  LINE  WEAPONS  EVALUATION 


DIFFERENTIAL  MANEUVERING  SIMULATOR  I STATE-OF-THE-ART  I960  WITH  RECENT  UPDATES  TO  IN- 


IDMS) 

NASA.  LANGLEY.  VA. 


CLUDE  NEW  HUD.  CONTROL  COMMAND  SYSTEM  AND  ON  LINE 
WEAPONS  EVALUATION.  CONSISTS  OF  TWO  40  FT  PROJEC- 
TION DOMES  WITH  ON  LINE  INTERACTIVE  COMPUTER  CON- 
TROL ONE-ON-ONE  MISSIONS.  HAVE  DEVELOPED  COMPUT- 
ERIZED MODEL  FOR  COMBAT  FLYING  WHICH  CAN  REPUCE 
PILOT  IN  ONE  SPHERE.  MODEL  FUNCTIONS  AS  COMPETITIVE 
OPPONENT  FOR  LIVE  PILOTS 


ADVANCED  SIMULATOR  FOR  UNDER- 
GRADUATE PILOT  TRAINING  (ASUPT) 
WILLIAMS.  AFB.  AZ. 


BECAME  OPERATIONAL  1975.  CONSISTS  OF  TWO  T-37B  COCK- 
Pin  AND  WAS  DESIGNED  AS  A TRAINING  AND  RESEARCH 
TOOL.  SYSTEM  IS  NOT  SET  UP  FOR  AIR-TO-AIR  COMBAT  BUT 
COULD  BE  MODIFIED  TO  INCLUDE  THAT  CAPABILITY.  THE 
ASUPT  HAS  A SIX  DEGREE  OF  FREEDOM  MOTION  CAPABILITY 
AND  USES  CRT  TECHNOLOGY  FOR  THE  OUT  OF  THE  COCKPIT 
DISPLAYS.  UTILIZATION  HAS  EMPHASIZED  TRAINING  RE- 
SEARCH 


SIMULATOR  FOR  AIR-TO-AIR  COMBAT 
ISAAC) 

LUKE.  AFB.  AZ. 


DELIVERED  IN  1975.  THIS  SYSTEM  CONSISTS  OF  TWO  F-4 
FORWARD  COCKPITS,  A SIX  DEGREE  OF  FREEDOM  MOTION 
CAPABILITY,  CRT  OUT-OF-THE-COCKPIT  SCENE  GENERA- 
TION AND  “G"  CUES.  IT  IS  LIMITED  TO  SIMUUTION  OF  AIR- 
TO-AIR  SEGMENTS  OF  THE  FLIGHT  REGIME.  THIS  SYSTEM  IS 
PRIMARILY  A TRAINING  TOOL  FOR  AIR  COMBAT  AND  TAC- 
TICS ALTHOUGH  IT  HAS  BEEN  USED  AS  A MEANS  FOR 
EVALUATING  DESIGNS  AND  MAKING  DISSIMILAR  AIRCRAFT 
COMPARISONS 


INSTRUMENTED  RANGES 


AIR  COMBAT  MANEUVERING 
INSTRUMENTATION  (ACMI) 
NELLIS,  AFB,  LAS  VEGAS,  NEV. 


/MCOO/V/VfX.A.  DOUGLAS 


TYPE  OF  STUDY 


AIRCRAFT  AND  COCKPIT  DESIGN 
EVALUATION  OF  AIR-TO-AIR  CAP- 
ABILITY OF  EXISTING  AND  AD- 
VANCED DESIGN  AIRCRAFT  CON- 
CEPTS TRAINING  FOR  F-15,  AV-8A 
F-18  AIRCRAFT  DURING  PRE- 
FLIGHT TESTING 


AIRCRAFT  EVALUATION  OF  DESIGN 
OPTIONS  FOR  AFTI,  HIMAT,  AV-8A 
F-4.  PARAMETRIC  STUDIES  OF  A 
NUMBER  OF  DESIGN  OPTIONS. 
EVALUATION  OF  TRAINING 
METHODS 


TRANSFER  OF  TRAINING  VALUE  OF 
SIMULATOR  MOTION  VISUAL  PARAM- 
ETERS REQUIRED  IN  TRAINING 
(TRAFFIC  PAnERNS;  CONTACT 
FLYING;  INSTRUMENT  FLYING) 
DEFINITION  OF  SIMULATOR  RE- 
QUIREMENTS 


.... . ...mk..  . became  operational  in  1973  AND  CAM 

^ TO  FOUR  HIGH  SPEED  AIRCRAFT  WITHIN  A 30  MILE  CYL- 

MARINE  CORPS  AIR  STATION,  YUMA,  AZ.  ALTITUDES  OF  FROM  5 TO  40  THOUSAND  FEET. 

DATA  ON  TRACKING,  WEAPONS  SELECTION,  RADAR  LOCK-ON, 
AND  AIRCRAFT  ATTITUDE,  ALTITUDE,  ACCELERATION,  AN- 
GLE OF  ATTACK  ANO  AIRSPEED  ARE  DATA  LINKED  TO  A 
GROUND  STATION  AND  RECORDED.  EXTENSIVE  DEBRIEFING 
FACILITIES  ARE  PART  OF  THE  SYSTEM  TO  ALLOW  REVIEW 
OF  THE  MISSIONS  FLOWN  ON  THE  RANGE.  AN  ADDITIONAL 
RANGE  HAS  BEEN  CONSTRUCTED  IN  VIRGINIA 


TRAINING  TO  HELP  NEW  PILOTS 
DEFINE  THE  MISSILE  ENVELOPE 
CANNOT  USE  GUNS  WITH  CURRENT 
SYSTEM.  EVALUATION  OF  NEW  AIR- 
CRAFT SYSTEMS  IN  MOCK  COMBAT 
ENGAGEMENTS.  ACCEPTANCE 
TESTING  OF  NEW  FIGHTER  AIR- 
CRAFT 


THIS  SYSTEM  IS  ESSENTIALLY  AN  ADVANCED  ACMR.  IT  BE- 
CAME OPERATIONAL  IN  JULY  1976  ANO  CAN  TRACK  UP  TO 
EIGHT  AIRCRAFT.  EXPANDED  DEBRIEFING  FACILITIES 
HAVE  BEEN  PROVIDED  INCLUDING  A LARGE  SCREEN  COLOR 
DISPUY.  INCREASED  MISSILE  TRACKING.  MISSILE  KILL 
PROBABILITY  DATA  ANO  GUN  FIRING  DATA  ARE  ALSO  IN- 
CLUDED IN  THE  NEW  SYSTEM.  ANOTHER  SIMILAR  RANGE  IS 
BEING  CONSTRUCTED  AT  TYNOAL  AFB  IN  FLORIDA 


EVALUATION  OF  NEW  MISSILE  SYS- 
TEM TACTICS  - CURRENTLY  USED 
FOR  ACEVAL-AIMVAL  PROGRAM:  A 
JOINT  AIR  FORCE  NAVY  (F-14, 
F-151  WEAPONS  AND  TACTICS 
EVALUATION  PROGRAM 


com^omMTtom 


PARAMETERS  STUDIED 


> WING  LOADING 

I AIRCRAFT  CONFIGURATION 

> CONTROL  CHARACTERISTICS 
. HI-''G"  COCKPIT 

. NEW  WUPONS  CONCEPTS 
. TACTICS  DEVELOPMENT 


. TIME  IN  CUN  r 
. WEAPON  Hin 
. THEORE 
> GUN  FIR 
. ROUNDS  F 
. KILL 
. AIRCf 
(SPEED  AL 


• WING  LOADING 

• AIRCRAFT  CONFIGURATION 
. THRUST  VECTORING 

. MANEUVERING  AUGMENTATION 

• ADAPTIVE  MANEUVERING 
LOGIC  MODEL 

• THRUST  TO  WEIGHT  STUDIES 


• TIME  ON 
. TIME  ON 
VANTAGE 

> AMLS.  GU 
. AIRCRAF 

> TIMES  IN 
ENVELOPES 


iii6. 

iiiL 


> A/G  TRAINING  AS  A FUNCTION 
OF  SIMUUTOR  MOTION 
• SMULATOR  REQUIREMENTS 
FOR  WIND,  TURBULENCE,  “G” 
SEAT  AND  FIELD  OF  VIEW 


. BOMBING  CEP 
. AIRCRAFT 
STEADINESS) 

• MEASURI 
FLIGHT 
TAKEOFF. 
360'’ 

UNDING 


TRAINING  EFFECTIVENESS  OF  THE 
SIMULATOR  (TAC  ACES  II).  PRI- 
MARILY AN  AIR-TO-AIR  SIMULATOR 
USED  FOR  TRAINING  IN  THE  TACTI- 
CAL AIR  COMMAND 


TRAINING  EFFECTIVENESS  OF 
SYSTEM.  THEY  HAVE  USED  A 
SERIES  OF  THREE  MANEUVERS 
TO  EVALUATE  PILOT  CAPA- 
BILITY 


• MISSI 

• GUN  ROUNDS 

• MISSILE  AND 

• KILLS 

• TIME  TO  KILL 


• N VS  N AIRCRAFT  TACTICS  • TIME  IN  ENVB 
> AIR  GROUND  COORDINATION  • MISSILE 

• DISSIMILAR  AIRCRAFT  TACTICS  • MISSILE  HITS 


• DEVELOPING! 
COMPOSITE  SCI 
FORMANCE  Ml 


FIGURE  6.0-1  OVERVIEW  OF  FACILITIES  STUDIED  AND  RESULTS  OF  THE  EVALUATION  OF, 
MANEUVERING  RANGES  AS  SELECTION  TOOLS  ' 
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PARAMETERS  STUDIED 

PERFORMANCE  MEASURES 

RELIABILITY 

VALIDITY 

REUTION  TO  COMBAT 

NNG  LOADING 
IIKRAFT  CONFIGURATION 
jONTROL  CHARACTERISTICS 
l■•■G"  COCKPIT 
n NEAPONS  CONCEPTS 
fACTICS  DEVELOPMENT 

. TIME  IN  GUN  ENVELOPE 
. NEAPON  HITS 

. THEORETICAL  WEAPONS  HITS 
. GUN  FIRING  TIME 
. ROUNDS  FIRED 
, KILL  PROBABILITY 
. AIRCRAFT  PARAMETERS 
(SPEED  ALTITUDE.  “Gs",  ETC) 

• GOOD  MECHANICAL  RELIA- 
BILITY 

• SMALL  SAMPLE  SIZE  DIO  NOT 
ALLOW  ADEQUATE  SAMPLE  TO 
PERFORM  MEANINGFUL  STA- 
TISTICS REGARDING  INDIVID- 
UAL RELIABILITY 

• DATA  TENDED  TO  GROUP  GOOD 
AND  POOR  PILOTS  ACROSS  ALL 
MEASURES 

• COMPARISONS  WERE  MADE  BE- 
TWEEN AIR  COMBAT  MANEU- 
VERING IN  THE  SIMULATOR 
AND  IN  FLIGHT  TEST.  GOOD 
CORRESPONDENCE  BETWEEN 
SIMUUTOR  AND  STREAK 
EAGLE  RECORD  TMIE-TO- 
CLIMB  TESTS 

NO  DATA 

MG  LOADING 
URCRAFT  CONFIGURATION 
IMRUST  VECTORING 
HMEUVERING  AUGMENTATION 
KMPTIVE  MANEUVERING 
LOGIC  MODEL 

THRUST  TO  NFIGHT  STUDIES 

• TIME  ON  OFFENSE 

• TIME  ON  OFFENSE  WITH  AD- 
VANTAGE 

• AMLS,  GUN  HITS.  MISSILE  HITS 

• AIRCRAFT  PARAMETERS 

• TIMES  IN  VARIOUS  OFFENSIVE 
ENVELOPES 

. GOOD  MECHANICAL  RELIABIL- 
ITY 

• INDIVIDUAL  RELIABILITY  FOR 
KILLS  AND  AMLS  MEASURES 
GOOD  (OJI  AND  M2,  RESPEC- 
TIVELY) TIME  ON  OFFENSE 
RELIABILITY  POOR  ((L27) 

. INDICATES  GOOD  MEASURE  OF 
INDIVIDUAL  PERFORMANCE 
CAN  BE  OBTAINED  WITH  A 
SIMULATOR 

GOOD  COMPARISONS  WERE  FOUND 
BETWEEN  FLIGHT  TEST  AND  SIM- 
UUTOR FOR  AERODYNAMIC 
QUALITIES.  ALSO  GOOD  DATA 
WITH  RESPECT  TO  TRACKING 
RUNS.  RESULTS  ON  AIR-TO-AIR 
MANEUVERING  WERE  ALSO  GOOD 
WHEN  COMPARED  WITH  RESULTS 
OF  COMBAT  HASSLE  PROGRAM 

NO  DATA 

A/G  TRAINING  AS  A FUNCTION 
OF  SMULATOR  MOTION 
ISIMLATOR  REQUIREMENTS 
FOR  NINO.  TURBULENCE.  "G" 
SEAT  AND  FIELD  OF  VIEW 

. BOMBING  CEP 
. AIRCRAFT  CONTROL  (STICK 
STEADINESS) 

. MEASURES  OF  AIRCRAFT 
FLIGHT  DEVIATIONS  DURING 
TAKEOFF.  CLIMB  ON  COURSE 
SM"  OVERHEAD  PAHERN,  AND 
LANDING 

• MECHANICAL  RELIABILITY 
GOOD 

• NO  DATA  ON  RELIABILITY  OF 
INDIVIDUAL  MEASUREMENT 

NO  DIRECT  FLIGHT  TEST  COM- 
PARISONS. CAREFUL  “FEEL" 
EVALUATION  BY  GROUP  OF 
PILOTS.  GENERALLY  OK  EX- 
CEPT FOR  SOME  DEFECTS  IN 
THE  CONTROL  UTENCY  AND 
THE  VISUAL  SYSTEM 

NO  DATA 

raining  effectiveness  OF 

mEM.  THEY  HAVE  USED  A 
ERIES  OF  THREE  MANEUVERS 
devaluate  pilot  CAPA- 
CITY 

• MISSILE  UUNCHES 

• GUN  ROUNDS  FIRED 

• MISSILE  AND  GUN  HITS 

• KILLS 

. TIME  TO  KILL 

• INDICATIONS  THAT  MECHANI- 
CAL RELIABILITY  NEEDS  UP- 
GRADING 

• NO  DATA  ON  RELIABILITY  OF 
INDIVIDUAL  MEASUREMENT 

LIMITED  TO  THE  RESULTS  OF 
THE  FOLLOW-ON  TEST  AND 
EVALUATION  OF  THE  SIMUUTOR 
JURE  im.  PILOT  OPINION  INDI- 
CATED IT  COULD  BE  USED  TO 
TRAIN  SELECTED  ASPECTS  OF 
FLIGHT  BUT  IT  ALSO  NEEDED 
IMPROVEMENT  IN  SOME  OF  THE 
ARUS 

NO  DATA 

• N VS  N AIRCRAFT  tactics 
1 AIR  GROUND  COORDINATION 
1 DISSIMILAR  AIRCRAFT  TACTICS 

• TIME  IN  ENVELOPE 

• MISSILE  LAUNCHES 

• MISSILE  HITS 

• INSTRUCTORrjUDGEMENn 

• AIRCRAFT  PARAMETERS 

• DEVELOPING  A CONTINUOUS 
COMPOSITE  SCORING  PER- 
FORMANCE INDEX 

• MECHANICAL  RELIABILITY 
GOOD;  MEETS  SPECS  ON  AC- 
CURACY 

. NO  DATA  ON  RELIABILITY 
WITH  RESPECT  TO  INDIVIDUAL 
PERFORMANCE.  SUCH  RECORDS 
NOT  AVAIUBLE  TO  US 

PILOT  OPINION  REGARDS  RANGE 
AS  USEFUL  TRAINING  TOOL. 
URGEST  SINGLE  DRAWBACK  IS 
NO  REAL  BULLETS  - FUR  IS 
NOT  A FACTOR.  HOWEVER,  THE 
MAJORITY  OF  PILOH  BELIEVE 
PERFORMANCE  ON  RANGE 
SHOULD  MIRROR  PERFORMANCE 
IN  COMBAT 

RESULTS  OF  TOF  GUN  SCHOOL 
INDICATED  SIGNIFICANT  OVER- 
ALL IMPROVEMENT  IN  KILL/ 

LOSS  RATIOS  IN  VIETNAM  FOR 
TOP  GUN  GRADUATES  BUT  DATA 
ARE  CONFOUNDED  BY  SELECTION 
PROCEDURES  FOR  TOP  GUN 

iM  VS  N AIRCRAFT  TACTICS 
Am  GROUND  COORDINATION 
OBSmiUR  AIRCRAFT  TACTICS 
IKSILE  CONCEPT  EVALUATION 



• SAME  AS  ACMR 

• INCLUDES  GUN  HITS  BASED  ON 
PROBABILISTIC  MEASURES  OF 
BULLET  DISPERSION  WITHIN 
THE  CONE  OF  MEASUREMENT 
ERROR  OF  THE  SYSTEM 

• THEORETICAL  MISSILE  HITS 
(HIT  IF  FIRED) 

SAME  AS  ACMR 
POSSIBILITY  OF  DATA  ON 
ACEVAL-AIMVAL  PILOTS  DURING 
CURRENT  PROGRAM.  SHOULD  BE 
DONE  TO  EVALUATE  INDIVIDUAL 
RELIABILITY 

NO  DATA 

OPERATION  TOO  RECENT  TO 
HAVE  GENERATED  SIGNIFICANT 
DATA 

NO  DATA 

RESULTS  OF  THE  EVALUATION  OF  SIMULATORS  AND  AIR  COMBAT 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


MCOOMMCLL  DOUGLAS^ 


that  simulators  can  be  specially  designed  so  as  to 
provide  adequate  test  beds  for  pilot  selection  pur- 
poses and  further,  that  data  produced  from  man-on- 
man  air  combat  simulation  encounters  can  be  used 
to  reliably  discriminate  among  pilots. 

6.1.1  The  McDonnell  Douglas  Manned  Air  Combat 
Simulator  at  St.  Louis.  Missouri  - The  McDonnell 
Douglas  Manned  Air  Combat  Simulator  (MACS)  system 
has  been  in  continuous  operation  since  1969.  During 
that  time,  heavy  emphasis  has  been  placed  on  air-to- 
air  combat  simulations  as  they  relate  to  advanced 
engineering  and  avionics  evaluations.  Over  the 
years  the  hardware/software  that  drive  the  MACS 


have  been  improved  several  times  so  that  today 
MACS  represents  a reliable  air-to-air  combat 
simulation  test  bed  (see  Figure  6.1-1). 

6. 1.1.1  Facilities  Description  - The  MACS 
is  a real-time,  fixed  base,  four  aircraft  simula- 
tor employing  four  piloted  crew  stations,  all 
with  out-the-window  visual  scenes.  These  crew 
stations  are  "linked  together"  through  computers 
to  provide  an  interactive  air-to-air  simulation 
of  one -versus -one  up  to  a two-versus-two  combat 
engagement  scenario.  All  cockpits  are  especi- 
ally configured  to  represent  the  particular 
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a)  PILOT  COCKPIT  DISPLAY  DOMES 
g)  AIRCRAFT  AND  HORIZON  GENERATOR 
(3)  COMPUTER  CONTROL 


FIGURE  6.H  THE  MCDONNELL  DOUGLAS  FLIGHT  SIMULATION  FACILITY 

THE  MCDONNELL  DOUGLAS  MANNED  AIR  COMBAT  SIMULATOR  (MACS)  IS  EMBEDDED  IN  THE 

LARGER  FLIGHT  SIMULATION  FACILITY  AT  ST.  LOUIS,  MISSOURI. 

THE  PRINCIPAL  COMPONENTS  OF  THE  MACS  ARE  SHONN  ABOVE. 
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simulated  aircraft  and  employ  active  flight  instru- 
mentation including  a three-axis  attitude  direction 
indicator,  a Mach  meter,  an  airspeed  indicator, 
an  angle-of-attack  indicator,  a rate  of  climb  indi- 
cator, an  altimeter  and  a g meter. ^ 

The  35  air-to-air  combat  simulation  studies 
(totaling  more  than  6,000  engagements)  conducted  in 
MACS  have  evaluated  F-4,  F-15,  F-18,  AV-8A  fighter 
aircraft,  as  well  as  a number  of  advanced  design 
aircraft  concepts.  Threat  aircraft  have  included 
the  MIG-17,  the  MIG-23  and  USAF  aircraft  such  as 
the  F-4,  F-5,  and  F-106.  All  35  simulation  studies 
were  reviewed  to  identify  those  having  sufficient 
commonality  and  experimental  goodness  for  purposes 
of  this  evaluation.  A summary  of  these  simulations 
is  shown  in  Figure  6.1-2A 

Because  of  the  differences  in  aircraft  and 
weapons  systems  studies,  some  criteria  for  common- 
ality were  required  to  get  comparable  measures  of 
effect  between  simulation  studies.  To  accomplish 
this,  and  to  maintain  the  largest  number  of  simu- 
lations possible,  a guns-only,  one-on-one  scenario 
was  chosen.  This  is  the  only  specific  commonality 
between  the  simulations  evaluated.  The  guns-only 
scenario  involves  concentrated  maneuvering  and  a 
final  close  in  - 3000  feet  or  less  - approach  to 
the  adversary  aircraft,  two  factors  which  are  well 
suited  to  evaluating  pilot  proficiency.  This  cri- 
terion eliminated  25  of  the  35  studies  listed  in 
Figure  6.1-2A.^  A number  of  procedural  criteria 


AIRCRAFT 

NUMBER  OF 
SIMULATIONS 

NUMBER  OF 
ENGAGEMENTS 

PURPOSE  OF  SIMULATION 

F-lb 

13 

2097 

FLIGHT  TEST  TRAINING, 
ONE-ON-ONE.  TWO-ON-ONE, 
BEYOND  VISUAL  RANGE 
MISSILES.  ENGINEERING 
EVALUATIONS 

AV-8A 

7 

1250 

PROCEDURAL  EVALUATION  OF 
NOZZLE  CHANGES,  TWO-ON-ONE, 
AV-8A  VERSUS  MIG-17  AND  MIG-21. 

F-i 

3 

516 

BEYOND  VISUAL  RANGE  MISSILE. 

ADVANCED 

AIRCRAFT 

12 

2203 

WEAPONS  EVALUATION. 
EVALUATION  OF  AVIONICS  AND 
AIRCRAFT  DESIGN  CONCEPFS. 

TOTAL 

35 

6066 

FIGURE  6.1-2A  MACS  SIMULATIONS  REVIEWED  TO  DEVELOP 
DATA  BASE  FOR  EVALUATION  OF  SIMULATORS 
AS  A SELECTION  TOOL 
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AIRCRAFT 

NUMBER  OF 
SIMULATIONS 

NUMBER  OF 
ENGAGEMENTS 

PURPOSE  OF  SIMULATION 

F-15 

1 

192 

F-15  VERSUS  MIG-23 

AV-8A 

3 

888 

AV-8A  VERSUS  MIG-17  AND  MIG-21 

ADVANCED 

AIRCRAFT 

3 

435 

HIGH  ACCELERATION  COCKPIT, 
ADVANCED  TACTICAL  FIGHTER, 
VERTICAL  LIFT  FIGHTER  AIR 
COMBAT  PERFORMANCE  EVALU- 
ATION 

TOTAL 

7 

..  1515 

FIGURE  6.1-2B  MACS  SIMULATIONS  WHICH  MET  THE 
CRITERIA  FOR  USE  AS  SIMULATOR  EVALUATION 
DATA  BASE  ' 


FIGURE  6.1-2  SUMMARY  OF  MACS  SIMULATIONS 
PERFORMED  OVER  THE  LAST  FIVE  YEARS 


were  used  to  evaluate  the  remaining  ten  studies. 

First,  a minimum  of  three  pilots  must  have 
participated  in  the  study.  Second,  each  pilot  must 
have  flown  at  least  25  sorties  to  establish  a rea- 
sonable data  base.  Third,  the  study  itself  must 
have  been  conducted  in  a relatively  orderly  fashion 
with  a minimum  of  engineering  changes  in  procedures, 
hardware  and  software  during  the  course  of  the 
study.  This  eliminated  three  more  studies  leaving 
a total  of  seven  studies  which  met  our  minimal 
criteria.  These  studies  comprised  a total  of  over 
1500  sorties  and  30  pilots,  approximately  a fourth 
of  the  total  number  of  sorties  run  over  the  last 
five  years  (see  Figure  6.1-2B).  The  studies  dealt 
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■’Other  instruments  and  CRT  display  capability 
for  radar,  IR,  LLLTV  and  moving  map  simulations, 
as  well  as  warning  lights  and  switches,  are  avail- 
able in  the  cockpits  for  special  purpose  simula- 
tions. Full  manual  controls  are  included  in  the 
cockpit  with  realistic  force  gradients  and  an 
active  trim  switch.  Physiological  cues  are  also 
incorporated  into  the  cockpit  to  simulate  g load, 
buffet,  sound,  and  blackout-grayout. 

^Of  the  35  studies,  nine  were  concerned  with 
missiles  or  exotic  weapons  evaluation,  or  used  a 
two-on-one  scenario.  Of  the  remaining  simulations, 
a number  were  engineering  evaluations  and  did  not 
have  formal  reports  detailing  the  pilot  performance 
data  or  the  procedures  of  the  simulation  study. 
Others  did  not  have  reports  complete  enough  for  the 
type  of  analysis  we  required  (12  studies).  Three 
additional  studies  were  not  issued  in  time  for 
inclusion  in  this  analysis. 
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with  air-to-air  combat  evaluations  of  the  capabil- 
ities of  the  F-15,  the  AV-8A,  and  a group  of 
advanced  design  aircraft. 

6. 1.1. 2 The  F-15  Simulation  - The  F-15  simu- 
lation consisted  of  a one-on-one,  close-in,  air-to- 
air,  guns-only  combat  between  the  F-15  and  repre- 
sentative enemy  fighters.  Test  objectives  were  to 
obtain  data  within  a controlled  test  environment  of 
the  F-15's  air  superiority  over  the  two  types  of 
threat  aircraft.  This  simulation  involved  the 
F-15's  pilot/weapons  system  interface,  aircraft 
maneuvering,  crew  station  controls  and  displays, 
the  fire  control  system  and  the  internal  M61A1 
cannon.  The  F-15  was  flown  in  two  configurations, 
an  all-up  mode  in  which  all  systems  functioned  and 
a back-up  mode  in  which  selected  systems  were 
assumed  to  be  down. 

To  minimize  variability  from  extraneous 
sources,  a balanced  test  was  defined  where  four 
pilots  selected  by  the  F-15  Special  Projects  Office 
alternated  in  flying  both  the  threat  and  F-15  air- 
craft. Each  test  period  simulated  up  to  six  minutes 
of  combat  and  was  initiated  at  one  of  two  altitudes 
(10,000  or  30,000  feet).  Each  engagement  began 
with  one  or  another  of  the  aircraft  having  a posi- 
tional advantage  and  overtake  speed  (see  Figure 
6.1-3).  The  variables  were  systematically  varied 
to  control  test  biases. 
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INITIAL  CONDITIONS 
O- 10,000  FEET  COJILTITUOE 
®-  30,000  FEET  CO-ALTITUDE 


DEFENDER  AT  0.8S  MACH 
ATTACKER 

RANGE,  NMI  SPEED 


1 IJSM  ai32  FPS) 

2 U5M  0240  FPS) 

3 I J2M  0315  FPS) 

4 1.29M  0390  FPS) 


NMI  - NAUTICAL  MILES 
FPS  - FEET  PER  SECOND 
M-MACH 

INDICATES  AIRCRAFT  POSITION 

FIGURE  6.1-3  THIS  FIGURE  ILLUSTRATES  THE 
STARTING  CONDITIONS  WHICH  HAVE  BEEN  USED  FOR 
THE  F-15  CLOSE-IN  MANNED  AIR  COMBAT 
ENGAGEMENTS 
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The  total  test  schedule  (which  was  preceded 
by  a five-day  indoctrination  and  training  period) 
involved  129  air-to-air  combat  engagements  over  a 
four-day  period.  The  primary  objective  of  each 
pilot,  as  defined  by  test  procedures,  was  to  maxi- 
mize his  kill  advantage  over  his  opponent.  To 
this  end,  he  could  maneuver  and  fire  freely  with- 
in the  constraints  of  his  fuel,  his  ammunition 
load,  and  the  limits  of  his  aircraft's  flight 
capabilities. 

6. 1.1. 3 The  AV-8A  Simulation  - The  AV-8A 
(Harrier)  simulation  consisted  of  a series  of  three 
separate  simulations  each  having  three  friendly  and 
two  threat  pilots  and  making  a total  of  nine 


friendly  and  six  threat  pilots.  As  all  three  simu- 
lations were  essentially  replications  of  the  same 
study,  they  will  be  considered  together.  These 
simulations  engaged  the  AV-8A  against  the  Fresco  C 
(MIG-17)  and  Fishbed  J (MIG-21)  in  one-on-one  air 
combat.  The  objectives  of  the  simulation  program 
were  to  provide  data  on  thrust  vector  control 
effectiveness  and  maneuver  effectiveness.  Overall, 
the  major  question  was  whether  a subsonic,  thrust 
vectored  aircraft  could  survive  against  a high 
performance  supersonic  threat  aircraft.  Each  AV-8A 
pilot  received  two  days  of  familiarization  within 
the  combat  environment  and  then  four  days  of  inten- 
sive one-on-one  training  against  threat  aircraft 
manned  by  experienced  pilots.  Primary  emphasis  was 
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STARTING  GEOMETRICS  FREQUENCY 

- FAVORABLE  TO  AV-(A  - 1 

- NEUTRAL  - 2 

-UNFAVORABLE  TO  AV-tA  -5 


NOTE: 

I INDICATES  THREAT  POSITION 
O AND  HEADING 


O AND  HEADING 

ALL  ENGAGEMENTS  BEGIN  WITH: 

-AV-8A  AND  THREAT  AT  10,000  FT  ALTITUDE 
-AV-8A  WITH  60%  INTERNAL  FUEL 
-THREAT  WITH  75%  INTERNAL  FUEL 


INITIAL 

CONDITION 


FAVORABLE 

1 . INITIAL  MACH 

TO 

AV-8A 

FRESCO 

(MIG-17) 

AV-8A 

FISHBED 

(MIG-21) 

THREAT 

0.70 

0.85 

IL85 

1.02 

THREAT 

0.70 

0.85 

0J5 

1.06 

THREAT 

0.70 

OJO 

0J5 

U5 

THREAT 

0.70 

0.90 

0.85 

1J5 

THREAT 

0.70 

0J5 

a85 

1.05 

^ • 

OJO 

0.70 

0.85 

1.05 

0.70 

OJO 

0J5 

1.05 

AV-6A 

0.05 

0.70 

0.85 

0.70 

'FISHBEO  HAS  ENERGY  ADVANTAGE 

FIGURE  6.1-4  THIS  FIGURE  ILLUSTRATES  THE  INITIAL 
CONDITIONS  WHICH  HAVE  BEEN  USED  IN 
THE  AV-8A  MANNED  AIR  COMBAT  EN- 
GAGEMENTS 


design.  All  pilots  flew  against  the  threat  air- 
craft and  pilots  an  equal  number  of  times  from  an 
ordered  sequence  of  starting  conditions  (see  Figure 
6.1-4).  In  all,  427  one-on-one  engagements  were 
flown  with  a maximum  duration  of  three  minutes. 

The  data  analysis  considered  missions  having  a 
duration  of  more  than  150  seconds  as  completed. 

6. 1.1. 4 Advanced  Design  Aircraft  Simulations  - 
The  last  group  of  simulations  involved  advanced 
concept  aircraft  in  a one-on-one  situation  invol- 
ving both  real  and  conceptual  threat  aircraft.  The 
advanced  design  concepts  were  the  High  Acceleration 
Cockpit  (HAC),  the  Vectored  Lift  Fighter  (VLF)  and 
the  Advanced  Fighter  Technical  Integration  (AFTI) 
(see  Figure  6.1-2).  The  HAC  incorporates  a reclined 
seat  which  allows  a significant  increase  in  pilot 
g tolerance.  This  concept  was  demonstrated  to  be 
very  effective  and  is  currently  being  implemented 
in  an  aircraft  for  flight  testing.  The  VLF  incor- 
porated concepts  allowing  for  direct  fuselage 
aiming  and  directional  changes  through  vectored 
thrust,  making  it  a highly  maneuverable  aircraft. 

The  AFTI  incorporated  a number  of  new  technologies 
including  the  vectored  thrust  concept,  the  high 
acceleration  cockpit  and  a number  of  new  avionics 
concepts.  As  was  the  case  with  the  other  simula- 
tions, a balanced  design  was  used  throughout, 
allowing  each  pilot  to  fly  all  aircraft  against 
all  other  pilots  under  a variety  of  starting  geome- 
tries. In  all  cases,  instructions  were  given  that 
aggressive  air-to-air  combat  was  to  be  initiated, 
although,  in  some  cases,  the  development  aircraft 
was  so  superior  to  the  threat  that  avoiding  being 
shot  down  was  the  best  the  threat  could  hope  for. 


on  AV-8A  defensive  maneuvers.  A small  percentage 
of  training  was  given  for  offensive  maneuvering, 
and  each  AV-8A  pilot  was  given  an  opportunity  to 
fly  both  threat  aircraft.  One-on-one  combat  was 
initiated  from  eight  starting  conditions  - five  of 
which  placed  the  AV-8A  at  a disadvantage.  All 
engagements  were  characterized  by  close-in  hard 
maneuvering.  The  number  of  engagements  and  amount 
of  time  spent  against  each  threat  were  nearly  equal 
as  intended  in  the  counterbalanced  experimental 


6.1.2  The  Differential  Maneuvering  Si mulator 
at  NASA,  Langley,  Virginia  - The  Differential  Maneu- 
vering Simulator  (DMS)  at  the  National  Aeronautics 
and  Space  Administration  (NASA),  Langley  Air  Force 
Base,  Hampton,  Virginia,  was  reviewed  as  part  of 
our  evaluation  of  air  combat  simulators  as  possible 
selection  test  instruments  for  identifying  combat 
effective  fighter  pilots.  The  QMS,  which  began 
operation  in  1971,  makes  it  possible  to  study  the 
interactive  maneuvering  of  two  vehicles  (and  pilots) 
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as  they  perform  in  a variety  of  air  combat  engage- 
ments. ■''hs  facility  was  developed  to  provide  NASA, 
Langley  with  simulation  capabilities  that  would 
work  in  conjunction  with  other  NASA  research  facil- 
ities and  complement  the  work  of  the  design  groups, 
wind-tunnel,  and  flight  research  projects.  Opera- 
tions have  concentrated  on  one-on-one  air  combat 
maneuvering  investigations  with  the  objective  of 
systematically  studying  advanced,  novel,  or  innova- 
tive concepts  of  aircraft  and  systems  that  could 
improve  the  combat  effectiveness  of  future  fighter 
aircraft  (Meintel,  Pennington,  and  Hankins,  1973). 

6. 1.2.1  Facility  Description  - The  system  was 
based  on  the  use  of  available  state-of-the-art 
components  (circa  1968).  It  consists  of  two  40-foot 
diameter  projection  spheres  each  housing  a cockpit 
and  projection  system,  interface  control  consoles. 


and  two  image  generating  systems.  The  systei;i 
provides  a 350°  field-of-view  and  extends  from 
directly  overhead  to  60°  below  the  horizon  except 
for  those  areas  occluded  by  the  aircraft  nose.'' 
Controls  are  loaded  to  represent  proper  control 
feedback  and  force  characteristics.  Opponent 
aircraft  and  relevant  ground  cues  are  projected 
on  the  inner  surface  of  the  spheres  (see  Figure 
6.1-5). 

The  system  does  not  include  a vertical  motion 
capability  although  up  to  one  q buffet  can  be 
induced  on  the  cockpit.  Additional  flight  cues 
such  as  sound,  rudder  pedal  shaker,  g-suit 


‘‘Vision  immediately  behind  the  pilot  is 
occluded  by  the  target  equipment  (see  Figure 
6.1-5). 


PROJECTION 
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inflation,  and  blackout  are  also  provided.  Signif- 
icant improvements  have  been  made  in  the  simulation 
hardware  as  the  need  has  become  evident.  An  updated 
HUO  was  added  in  early  197b.  On-line  missiles  were 
added  in  1975,  and  on-line  guns  were  added  in  late 
1975.5  These  features  provide  on-line  firing 
information  and  feedback  to  the  pilot  regarding 
weapons  utilization  - an  important  factor  in 
realistically  simulating  air-to-air  combat. 

The  design  and  analysis  aspects  for  the  simu- 
lation studies  run  on  the  DMS  are  handled  by  a 
single  group  which  has  generated  a standard  set  of 
performance  scores,  standard  test  designs  and 
comprehensive  computerized  data  reduction  packages 
which  allow  efficient  date  reduction  and  analysis 
(see  Appendix  6. A) . 

6. 1.2. 2 Adaptive  Maneuvering  Logic  Model  - 
NASA,  Langley,  as  part  of  its  program  on  interac- 
tive air-to-air  combat,  has  developed  a computer 
logic  model  called  Adaptive  Maneuvering  Logic  (AML) 
to  control  a simulated  aircraft  for  combat  with  a 
human  pilot.  This  computer-controlled  opponent  or 
"iron  pilot"  not  only  allows  a better  understanding 
of  air  combat  maneuvering  but  can  serve  as  a stan- 
dard pilot  against  which  to  evaluate  training, 
proficiency  maintenance,  and  selection  procedures. 

The  model  was  developed  in  conjunction  with 
Decision  Sciences,  Inc.,  to  replace  the  pilot  in 
one  of  the  two  spheres  of  the  OMS  (Burgin,  Fogel, 
and  Phelps,  1975).  The  model  is  based  on  flying 
a series  of  maneuver  segments  which  are  continu- 
ally updated  based  on  the  flight  maneuvers  of  the 
opponent  aircraft.  The  model  predicts  the  future 
state  of  its  opponent  from  its  past  position.  The 
best  maneuver  is  then  selected  from  the  possible 
maneuvers,  based  on  a 12-item  logic  system  evaluat- 
ing the  positional  advantage  achieved  by  each 
alternative.  The  highest  scoring  alternative  is 
then  executed,  and  the  process  continues.  The  up- 
date occurs  once  every  second  making  the  "iron 
pilot"  highly  responsive  to  the  opponent's  maneuver- 
ing. The  scores  from  the  12-item  AML  positional 
advantage  evaluation  are  also  used  as  a composite 
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criterion  of  pilot  performance  called  Adaptive 
Maneuvering  Logic  Scores  (AMLS).  A full  descrip- 
tion of  the  AML  is  found  in  Appendix  6.8.  The  AML 
Model  has  been  used  with  a number  of  pilots  and 
has  achieved  good  acceptance  as  a realistic  and 
competitive  opponent  (Hankins,  1976). ^ The  basic 
model  as  reported  here  has  been  continually  up- 
graded, and  a new  version  is  scheduled  for  inclu- 
sion in  the  Manned  Air  Combat  Simulator  being 
developed  by  McDonnell  Douglas  for  the  Navy's 
upcoming  air-to-air  combat  training  simulation 
program  located  at  the  Naval  Training  Equipment 
Center,  Orlando,  Florida  (the  Navy's  2E6  program). 

6.1.3  The  Simulator  for  Air-to-Air  Combat  at 
Luke  Air  Force  Base,  Arizona  - The  Simulator  for 
Air-to-Air  Combat  (SAAC)  at  Luke  Air  Force  Base, 
Arizona,  was  evaluated  for  its  applicability  as  a 
tool  for  pilot  selection.  Built  by  Singer-Link 
for  use  by  the  Tactical  Air  Command  (TAC)  as  a 
training  system  for  air  combat  and  air  combat  tac- 
tics development,  its  role  has  since  been  expanded 
to  include  aircraft  design  and  dissimilar  aircraft 
comparisons.  The  installation  was  based  on  a 
requirement  documented  in  September  1965,  and  was 
delivered  to  Luke  Air  Force  Base  in  July  1975.  It 
is  presently  being  used  by  TAC  as  well  as  the  Air 
Force  Systems  Coimand  to  meet  both  training  and 
research  objectives. 

6. 1.3.1  Facility  Description  - The  SAAC  is  a 
two-cockpit,  interactive  Basic  Flight  Maneuvering 
and  Air  Combat  Maneuvering  (BFM  & ACM)  motion-based 
trainer  employing  advanced  CRT  technology  to  pro- 
duce the  out-of-the-cockpit  scenes.  The  system  is 
limited  to  air-to-air  segments  of  the  flight  regime 
using  the  forward  cockpit  of  an  F-4  aircraft.  No 
provisions  are  made  for  simulating  takeoff  and 
landings.  Major  components  of  the  system  are; 


^Personal  communication  with  the  NASA  simulation 
group. 

®Data  from  12  typical  pilots  flying  a lightweight 
fighter  against  the  AML  indicated  that  the  AML  won 
in  35  of  the  72  engagements  flown.  (Personal  com- 
munication from  W.  W.  Hankins,  NASA,  Langley,  1976). 
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two  F-4  cockpits;  a Xerox  Sigma  Five  Computer;  an 
instructor  and  operator  console;  g onset  simula- 
tion capability  (g-suit,  seat  and  blackout  cues); 
a hydraulic  motion  system;  and  a multi-screen  CRT 
display  system  to  simulate  the  out-of-the-cockpit 
scene  (see  Figure  6.1-6).  The  display  system  sim- 
ulates a 246°  by  150°  outside  field-of-view  of 
the  target  aircraft,  sky,  horizon  and  terrain. 

The  terrain  consists  of  a four-shades-of-gray 
matrix  of  1/2  mile  squares,  with  adjacent  squares 
having  different  gray  shades.  The  horizon  appears 
as  an  unfocused  band  between  earth  and  sky.  The 
target  aircraft  is  generated  from  a gimbal  mounted 
model  approximately  one  foot  in  length.  This 
entire  display  is  viewed  through  an  optical  glass 
window  which  focuses  the  CRT  images  at  infinity. 
Some  problems  were  found  with  the  resolution 
available  on  the  CRTs  during  ACM  in  that  at  dis- 
tances greater  than  one  mile  range,  aspect  angles 
were  very  difficult  to  determine  (Steward,  1976). 
The  capability  of  the  CRT  display  to  resolve  images 
is  about  1/4  to  1/2  of  that  of  the  eye  (DCS  Tactics 
Analysis  and  Development,  1976).  This  resolution 
mismatch  is  a major  deficiency  in  the  simulator  if 
it  is  to  be  used  as  a selection  tool  for  ACM  capa- 
bility. It  also  is  a significant  limitation  on 
training  for  ACM.  Improvements  for  this  function 
will  be  dependent  on  advancements  in  the  state-of- 
the-art  of  CRT  displays. 


The  cockpits  are  connected  to  a digital  compu- 
ter and  can  be  programmed  with  the  performance 
characteristics  of  any  U.S.  or  Soviet  aircraft, 
although  currently  the  target  model  is  limited  to 
the  F-4.  Thus,  while  the  opponent  aircraft  may  fly 
like  a MIG,  it  will  look  like  an  F-4.  The  computer 
can  simulate  avionics,  weapons,  and  design  changes 
and  modifications  as  the  software  becomes  available. 
At  present,  no  software  experts  conversant  with  the 
system  are  organic  to  the  installation  at  Luke. 

The  motion  capability  allows  six  degree  of 
freedom  movement  through  the  use  of  six  linear 
hydraulic  actuators  arranged  in  sets  of  three  pairs. 
These  actuators  can  provide  both  positional  and 
acceleration  cues  to  the  pilots. 

6. 1.3. 2 Research  - Because  of  the  relatively 
recent  delivery  of  the  SAAC,  no  research  directly 
relatable  to  pilot  selection  has  been  performed. 
However,  an  analytical  review  (Stewart,  1976)  of 
the  system  and  a transfer  of  training  study,  TAG 
ACES  II  (see  DCS  Tactics  Analysis  and  Development, 
1976),  to  evaluate  the  capability  of  the  SAAC  as  a 
training  device,  were  performed.  The  results  of 
both  these  studies  indicated  several  severe  defi- 
ciencies in  the  SAAC  as  a training  instrument, 
although  the  overall  impression  was  that  the  SAAC 
would  serve  a useful  training  function  once  the 
deficiencies  were  corrected. 


FIGURE  6.1-6  SIMULATOR  FOR  AIR-TO-AIR  COMBAT  AT 
LUKE  AIR  FORCE  BASE,  ARIZONA 


Measures  taken  in  the  TAC  ACES  II  study  were 
based  on  those  obtained  from  TAC  ACES  I,  a study 
by  LTV  using  the  Vought  Air  Combat  Simulator 
(VACS)  (Roberts,  1976).  Data  on  individual  pilots 
were  not  available  for  any  of  these  measures.^ 


'Three  maneuvers  were  evaluated:  a stabilized 
tracking  run;  a high  angle  raking  shot  run;  and  an 
ACM  maneuvering  sequence.  Details  of  the  three 
maneuvers  can  be  found  in  DCS  Tactics  Analysis  and 
Development,  1976.  Two  complete  runs  were  made  for 
each  of  the  first  maneuvers  and  one  of  each  for  the 
three  options  for  the  ACM  maneuver.  The  data  ob- 
tained for  each  maneuver  ore  listed  in  Figure  6.1-7. 
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Overall,  the  SAAC  could  be  used  for  pilot 
selection  provided  a number  of  deficiencies  can 
be  corrected.  These  include  an  upgraded  visual 
system,  software  experts  organic  to  the  SAAC, 
appropriate  target  models,  and  an  improved  system 
reliability  to  allow  for  efficient  utilization  of 
the  system. 
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DATA  REQUIREMENT 

MANEUVER 

NUMBER 

1 

2 

3 

111  PILOT  ID  NUMBER. 

X 

X 

X 

(2)  MANEUVER  NUMBER  1.  RUN  NUMBER. 

X 

X 

X 

|3>  AIM-9  LAUNCHED,  HOT  LAUNCHED,  BY  RUN. 

X 

(4)  AIM-9  KILL,  MISS.  BY  RUN. 

X 

(SI  NUMBER  OF  20  MM  HITS.  BY  RUN. 

X 

X 

161  NUMBER  OF  20  MM  EXPENDED.  BY  RUN. 

X 

X 

X 

(7)  PERCENT  OF  20  MM  HITS  EXPENDED,  BY  RUN. 

X 

X 

18)  TOTAL  AIM-9S  LAUNCHED. 

X 

X 

(9)  TOTAL  AIM-9  KILLS. 

X 

(10)  TOTAL  20  MM  HITS  BY  BOTH  RUNS. 

X 

X 

Ill)  TOTAL  20  MM  EXPENDED  FDR  BOTH  RUNS. 

X 

X 

62)  PERCENT  OF  HITS  EXPENDED  FOR  BOTH  RUNS. 

X 

X 

(13)  TIME  FROM  90“  ASPECT  TO  KILL 

X 

04)  TYPE  OF  WEAPON  USED  FOR  KILL. 

X 

FIGURE  6.1-7  DATA  REQUIREMENTS  FOR  THE  THREE 
MANEUVERS  USED  IN  TAG  ACES  I AND  II 


6.1.4  The  Advanced  Simulator  for  Undergraduate 
Pilot  Training  at  Williams  Air  Force  Base,  Arizona  - 
The  Advanced  Simulation  for  Undergraduate  Pilot 
Training  (ASUPT)  located  at  Williams  Air  Force  Base, 
Arizona,  became  operational  in  January  1975.®  The 
ASUPT  consists  of  two  T-;-37B  jet  trainer  cockpits 
and  was  designed  as  a training  and  research  tool 
for  undergraduate  pilots.  It  is  the  first  simulator 
developed  specifically  as  a behavioral  science  tool 
for  application  to  pilot  training  research,  and,  in 
that  respect,  is  one  of  the  most  sophisticated 
simulators  available. 


ered  an  appropriate  aircraft  for  fighter  operations 
In  principle,  the  system  could  fly  air  combat  simu- 
lations, but  significant  modifications  would  have 
to  be  made  to  both  the  cockpit  and  the  system  soft- 
ware to  include  the  required  weapons  systems. 
Although  the  ASUPT  was  developed  independently  of 
the  SAAC  (Simulation  for  Air-to-Air  Combat,  see 
Section  6.1.3),  they  have  many  features  in  common. 
This  is  not  surprising  as  they  both  were  developed 
by  the  same  company  (Singer)  during  the  same  time 
frame.  Both  use  the  same  type  of  motion  induction 
system  (ASUPT  has  an  additional  hydraulic  actuator 
for  safety  purposes)  and  a display  for  out-of-the- 
cockpit  viewing  dependent  on  computer-generated 
CRTs.  The  entire  visual  scene  is  computer-gener- 
ated, including  the  image  of  other  aircraft.  The 
scene  is  viewed  bv  the  pilot  through  a fisheye 
lens.  The  visual  system  consists  of  seven  CRTs 
plus  optics  giving  a mosaic  field  of  view  of  +150’’ 
horizontal  and  +110°,  -40°  vertical.  Special  sys- 
tems were  developed  as  the  low  efficiency  of  the 
optics  required  exceptionally  high  brightness  in 
the  CRTs.® 

The  brightness  requirements  eliminate  any  true 
color  capability  using  current  technology.  The 
ASUPT  also  has  extensive  provisions  for  modified 
operation  by  instructor  pilots.  These  include  both 
an  in-cockpit  station  (the  second  cockpit  set  has 
an  instructor  console),  a conventional  controller 
station,  and  a special  advanced  controller  station. 
In  addition,  computer-control  led  Advanced  Instruc- 
tional Provisions  (AIP)  are  available  which  enable 
the  instructor  to  insert  preselected  malfunctions 
into  the  simulated  aircraft.  This  system  also  has 
provisions  for  a computer-controlled  course  of 
instruction  allowing  automatic  sequencing  of  AIP. 
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6. 1.4.1  Facility  Description  - The  basic  cock- 
pits are  programmed  to  simulate  ground  operations, 
normal  and  abnormal  flight  conditions,  aerobatic 
flight,  formation  flying,  and  post-stall  and  spin. 

An  air-to-air  combat  capability  was  not  originally 
built  into  the  system  as  the  T-37B  is  not  consid- 


®This  description  is  based  on  a series  of  reports 
entitled.  Advanced  Simulation  in  Undergraduate  Pilot 
Training.  AFHRL-TR-75-59,  Vol . 1 to  VII,  Air  Force 
Systems  Command,  Brooks  AFB,  Texas,  June  1975. 

'The  specially  developed  CRTs,  said  to  be  the 
largest  in  the  world,  have  a total  radiation  output 
of  over  10,000  lumens  and  provide  1,000  raster  lines 
at  a brightness  of  between  630  and  840  foot  lamberts, 
about  the  brightness  of  a 50-watt  bulb,  (AFHRL-TR- 
75-59,  Vol.  I,  1975). 
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A full  description  of  this  system  can  be  found  in 
a series  of  Air  Force  Human  Resources  Laboratory 
reports  (AFHRL-TR-75-59,  Vo^ls.  I - VII,  1975). 

These  descriptions  are  currently  being  updated, 
and  the  new  report  should  be  released  before  the 
end  of  1977, 

6. 1.4. 2 Research  - The  ASUPT  serves  four  major 
purposes: 


6.1.5  Reliability  of  Simulator  Performance 
Measures  - The  adequacy  of  air  combat  maneuvering 
simulators  (ACMS)  as  a means  of  evaluating  pilots 
for  combat  effectiveness  is  dependent  on  two  major 
factors:  how  well  the  simulator  yields  reliable 

measures  of  performance;  and  the  extent  to  which 
these  measures  are  valid  predictors  of  combat  pro- 
ficiency. This  section  is  concerned  with  the 
reliability  of  the  measurements  used  in  the  existing 


i - 'i 
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1.  Determination  of  the  effects  of  simulator 
configurations  on  training,  e.g.,  effects  of  motion 
and  visual  field  on  teaching  students  to  fly. 

2.  Motion-g  seat-vision  interactions  using 
experienced  pilots  to  evaluate  simulator  design 
configurations. 

3.  Development  of  design  for  A-10  and  A-6 
simulations. 

4.  Development  of  engineering  requirements 
to  allow  the  most  cost  effective  design  of  future 
training  simulators. 

A number  of  studies  relating  to  these  purposes  have 
been  performed  including  evaluations  of  A-10  simu- 
lator requirements  and  an  air-to-ground  transfer 
of  training  study.  Neither  of  these  studies  has 
been  published  yet,  but  personal  communications 
with  Dr.  Thomas  Gray  at  Williams  Air  Force  Base  have 
indicated  significant  improvement  in  air-to-ground 
ordnance  delivery  following  simulator  training. 
Interestingly,  better  training  occurred  using  ASUPT 
as  a fixed  base  rather  than  a moving  base  simulator. 
The  simulator  motion  appeared  to  degrade  transfer 
of  training.  Similar  problems  with  motion  were 
indicated  by  Rust  (1975)  while  evaluating  the  ASUPT 
as  a training  device.  With  this  exception,  and  a 
few  comments  concerning  specific  control  "feel," 
the  ASUPT  seems  to  provide  a very  realistic  and 
useful  training  device.  It  would  have  highly  limited 
use  as  a system  for  pilot  selection  because  of  the 
problems  in  the  out-of-the-cockpit  display  and  the 
lack  of  a weapons  systems  capability. 


Reliability,  of  course,  refers  to  the  capabil- 
ity of  a measuring  instrument  to  yield  consistent 
values  when  measuring  the  properties  of  objects 
or  people.  It  requires  that  the  measuring  tool 
be  consistent  and  that  the  property  being  measured 
has  characteristics  which  can  be  measured.  For 
simple  physical  measures  (length,  duration),  this 
relation  is  clear  cut;  an  ACMS  measuring  pilot 
combat  proficiency  presents  a more  difficult  case. 
Within  the  context  of  this  study,  our  first  prior- 
ity is  to  establish  whether  the  ACMS  yields  con- 
sistent measures  of  pilot  performance. 

6. 1.5.1  Mechanical  Reliability  - ACMSs 
consist  of  large  integrated  groupings  of  computer 
hardware  and  software,  as  well  as  mechanical  and 
electrical  interfaces.  Because  of  this  complexity, 
subtle  subsystem  changes  can  significantly  degrade 
system  reliability  while  the  system  is,  to  all 
appearances,  still  functioning  perfectly.  To 
combat  this  unreliability,  "calibrations"  are 
made  on  major  subsystems  prior  to  each  series  of 
runs.  This,  in  effect,  compares  the  simulator  against 
a standard.  In  the  MACS,  for  example,  reliability 
is  established  with  programs  which  calibrate  the 
alignment  of  the  electro-optical  and  electro- 
mechanical linkages  and  the  control  display  inter- 
faces. Sights  and  head-up  displays  are  optically 
inspected  for  alignment.  With  the  advent  of  digi- 
tal simulation,  software  programs  maintain  a high 
degree  of  reliability  (once  thoroughly  debugged) 
and  are  seldom  a source  of  errors.  These  or  equi- 
valent procedures  assure  that  most  simulators  will 
produce  reliable  data,  short  of  having  some  catas- 
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trophic  failure  which  shuts  down  the  entire  sys- 
tem. Mechanical  reliability,  once  achieved,  is 
reflected  in  the  operational  performance  of  the 
simulator.  During  a recent  simulation,  the  F-15, 
exhibiting  its  air  superiority  capability,  achieved 
better  performance  than  the  threat  aircraft  for  all 
measures  of  pilot  performance  across  all  pilots. 

In  some  cases,  the  same  pilot  achieved  score  ratios 
as  great  as  100:1  between  his  performance  scores 
with  the  F-15  aircraft  and  threat  {McDonnell 
Douglas  Report  MDC  A1455,  1972).  Similar  consis- 
tencies were  found  with  NASA  simulations  evaluating 
empirical  estimates  of  aircraft  capability  (the 
Aircraft  Maneuvering  Parameter)  and  non-weapons 
oriented  measures  of  aircraft  performance 
(Beasley  and  Beissner,  1974). 

6. 1.5. 2 Measurement  Reliability  - The  aspects 
of  reliability  dealing  with  the  characteristics 
of  the  thing  to  be  measured  are  much  more  subtle. 
Pilot  proficiency  is  generally  considered  to  be  a 
result  of  some  combination  of  factors  including 
the  personality  and  the  physical,  perceptual  and 
cognitive  capabilities  of  the  individual.  Like 
intelligence,  it  is  an  implied  attribute  which  is 
defined  by  scores  on  the  measuring  instrument 
itself.  Thus,  a pilot  who  wins  frequently  in  the 
air-to-air  simulation  is  considered  to  have  more 
proficiency  than  one  who  loses  frequently.  This, 
of  course,  must  later  be  validated  against  an  out- 
side criterion  such  as  ACMR/I  performance  or 
actual  combat.  Such  validation  procedures,  along 
with  the  relationship  between  simulator  and  criter- 
ion performance,  will  be  discussed  later  in  the 
section  dealing  with  validity. 

Because  of  the  interactive  nature  of  air-to- 
air  combat,  a degree  of  uncertainty  is  associated 
with  the  outcome  of  any  engagement.  For  any  given 
run,  the  more  proficient  pilot  has  a higher  proba- 
bility of  winning;  however,  his  winning  is  not  a 
certainty.  Additionally,  the  data  can  have  a 
degree  of  non-transitivity  so  that  pilot  A can 
beat  pilot  B,  and  pilot  B can  beat  pilot  C,  but 
pilot  C can  win  over  Pilot  A.  This  occurrence  may 
be  a sampling  problem;  although  it  is  possible 


that  pilot  C has  a unique  maneuver  that  works  with 
pilot  A but  not  with  pilot  B.  This  pilot  by 
maneuver  interaction,  should  it  be  the  true  expla- 
nation, is  an  example  of  the  variability  which  can 
occur  in  a complex,  interactive  competition  between 
individual  pilots. 

The  variability  inherent  in  the  task  tends  to 
distribute  the  scores  around  some  mean  which  can  be 
considered  the  best  estimate  of  pilot  proficiency. 
Because  of  the  high  degree  of  variability  found 
in  pilot  performance  measures  from  ACMS,  a fairly 
large  sample  of  scores  must  be  obtained  before  a 
stable  estimate  of  an  individual's  capability  can 
be  obtained.  Given  such  a sample  for  a number  of 
pilots,  the  reliability  of  a performance  measure, 
called  a reliability  coefficient,  can  be  estimated 
through  the  use  of  correlational  statistics.  These 
statistics  yield  estimates  of  how  close  a pilot's 
score  will  correspond  with  a second  score  taken 
under  the  same  conditions."  If  the  degree  of 
correspondence  is  high,  the  measuring  tools  used 
to  obtain  the  scores  can  be  considered  to  generate 
reliable  estimates  of  the  pilot's  capability. 

6 . 1 . 5 . 3 Performance  Measures  and  Data  Gener- 
ated by  AMDS  - The  analysis  of  effective  performance 
of  any  simulation  depends  on  the  capability  of 
the  system  to  produce  reliable  objective  response 
measures  which  relate  to  overall  performance.  The 
simulations  run  at  McDonnell  Douglas  in  the  MACS 


*°Such  breakdowns  are,  unfortunately,  all  too 
frequent  due  to  the  complexity  of  the  system.  In 
some  cases  like  the  SAAC  (Stewart,  1976),  they  have 
compromised  the  usefulness  of  the  ACMS. 

"The  scores,  of  course,  must  be  taken  under 
near  identical  conditions  to  keep  sources  of 
extraneous  variation  to  a minimum.  One  of  the 
best  techniques  for  meeting  these  requirements  is 
to  obtain  the  reliability  coefficient  through  the 
split-half  technique.  This  technique  takes  one 
half  of  a series  of  measurements  and  correlates  it 
against  the  other  half.  Scores  can  be  assigned  to 
halves  on  an  "odds"  to  one  half,  "evens"  to  the 
other,  or  on  the  basis  of  a counterbalancing  scheme 
where  each  half  has  scores  taken  under  as  near 
identical  circumstances  as  possible. 
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have  typically  used  11  such  measures  of  performance. 
The  simulations  analyzed  for  this  study  have  used 
from  four  to  seven  of  these  measures  (see  Figure 

6.1-8)  as  criteria  for  evaluating  air  combat  effec- 
tiveness. The  criteria,  for  the  most  part,  can  be 
considered  as  a series  of  sequentially  dependent 
tasks  with  a final  criterion  of  probability  of  kill 
(P|^).  These  criteria  are,  in  order  of  dependence, 
expanded  gun  envelope,*^  gun  envelope,  gun  fire  time 
or  rounds  fired,  type  2 hits  (those  within  20  feet 
of  the  opponent's  center  of  gravity),  type  1 hits 
(those  within  10  feet  of  the  opponent's  center  of 
gravity),  and  Pj^.  In  addition  we  have  values  for 
theoretical  Type  1 and  Type  2 hits  which  indicate 
the  average  time  hits  would  have  been  made  had  the 
gun  been  fired.  All  these  measures  are  obtained 
through  either  direct  timing  of  operations,  cal- 
culating the  time  an  aircraft  falls  within  a set  of 
parameters  or  calculating  the  projected  path  of  the 
bullets  given  the  flight  paths  and  other  variables 
relating  to  the  two  aircraft. 
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MEASURES 

AV8A 

HAC 

F-15 

VLF 

AFTI 

TIME  IN  EXPANDED  ENVELOPE 

X 

TIME  IN  ENVELOPE 

X 

X 

OFF  OR  ADVANTAGE  TIME 

X 

GUN  FIRE  TIME 

X 

X 

X 

ROUNDS  FIRED 

X 

X 

X 

Tj  aO  FT  CG)  HITS 

X 

X 

X 

X 

X 

Tj  (20  FT  CG)  HITS 

X 

X 

X 

X 

X 

THEORETICAL  T[  HITS 

X 

THEORETICAL  T2  HITS 

X 

X 

POF  KILL 

X 

X 

TIME  TO  1ST  SHOT 

X 

FIGURE  6.1-8  PILOT  PERFORMANCE  MEASURES  USED  IN 
THE  SIMULATIONS  RUN  AT  MCDONNELL  DOUGLAS 


As  shown  in  Figure  6.1-8,  the  only  consistent 
measure  across  the  MACS  simulations  were  Type  1 
and  Type  2 hits.  This  lack  of  consistency  of 
criteria  underscores  a pervasive  problem  in  eval- 
uating simulation  studies.  There  are  no  existing 
standardized  performance  criteria  for  measuring 


pilot  proficiency.  New  sets  of  performance  mea- 
sures are  generated  independently  for  each  simula- 
tion. This  lack  of  consistency  makes  the  cross- 
evaluation  of  a group  of  simulations  extremely 
difficult  as  there  are  often  few,  if  any,  common 
measures  to  analyze. 

6. 1.5. 4 Performance  on  the  McDonnell  Douglas 
Manned  Air  Combat  Simulator  - The  data  obtained 
from  the  seven  MACS  simuilations  are  shown  in  Fig- 
ures 6.1-9  through  6.1-13  (the  three  AV-8A  simula- 
tions are  grouped  together).  Examining  these  data, 
it  becomes  obvious  that  large  differences  in  perfor- 
mance exist  within  a given  simulation  across  a 
number  of  performance  measures. 

In  the  case  of  the  HAF  study  (see  Figure 

6.1- 11),  Pilot  1 consistently  has  the  lowest  scores 
across  all  measures  except  Type  1 gun  hits.  The 
differences  are  large  and  consistent  enough  to  make 
this  pilot  a candidate  for  transfer  out  of  a fighter 
program.  Pilots  1 in  the  VLF  simulation  (see  Figure 

6.1- 12)  and  3 in  the  AFTI  simulation  (see  Figure 
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PILOT  1 

4.69 

310 

4.55 

18.89 

2 

4.82 

265 

2.31 

8.92 

3 

3.51 

223 

9.17 

28.52 

4 

4.31 

266 

5.45 

18.28 

MEAN 

4J3 

266 

5J7 

18.65 

STANDARD 

DEVIATION 

0.61 

35.52 

2.86 

8.01 

FIGURE  6.1-9  AVERAGE  VALUES,  OVERALL  MEANS  AND 
STANDARD  DEVIATIONS  FOR  PERFORMANCE  MEASURES 
USED  IN  F-15  SIMULATIONS 


'^Normal  gun  envelope  consisted  of  a tracking 
error  of  within  + 3",  angle-off  target  tail  of  less 
than  30°  and  a range  of  under  3.000  feet.  The 
expanded  gun  envelope  was  included  for  the  AV-8A 
tests  because  of  the  low  frequency  of  gun  envelope 
solutions  during  the  conduct  of  the  simulation. 

This  expanded  gun  envelope  consists  of  a tracking 
error  of  less  than  + 5°.  30°  angle-off  target  and 
a range  of  under  3.000  feet. 
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6.1-13)  show  consistent  superiority  over  all  mea- 
sures taken.  In  all  three  cases,  the  sample  size 
is  not  large  enough  to  compute  meaningful  statistics. 
In  addition,  all  measures  (with  the  exception  of 
time  to  fire  and  offensive  time)  relate  to  gun  fir- 
ing and  hits.  Reviewing  the  data  from  the  F-15 
simulation,  (see  Figure  6.1-9)  which  included  time 
in  gun  envelope  measures,  we  observed  reversals  in 
performance  between  gun  envelope  and  hits  data, 
i.e.,  the  best  pilot  on  the  hits  measure,  pilot  3, 
was  the  worst  on  the  time  in  gun  envelope  measure. 

The  same  kind  of  reversal  is  found  in  the  AV-8A 
simulation  for  pilot  4 (see  Figure  6.1-10).  The 
inconsistencies  in  performance,  between  time  in  gun 
envelope,  rounds  fired,  and  nits  can  be  accounted 
for  by  a number  of  testable  hypotheses.  Among  these 
are  the  effective  use  of  high  deflection  shots  and 
firing  only  at  close  range,  where  maximum  hits  are 


achieved.  Despite  these  occasional  anomalies,  how- 
ever, the  general  trends  of  the  data  show  that  some 
pilots  are  clearly  superior  to  others.  To  illus- 
trate these  trends,  the  data  relating  to  the  AV-8A 
simulations,  which  contain  the  largest  pilot  group 
run  in  the  MACS  (see  Figure  6.1-10),  were  reworked 
into  performance  rankings  (see  Figure  6.1-14). 

This  figure  shows  consistent  and  clear  differences 
between  the  best  and  poorest  pilots.  Pilots,  8,  2, 
11,  and  14  all  rank  consistently  in  the  top  third, 
and  pilots  9,  6,  10  all  rank  in  the  lower  third. 
Some  interesting  hypotheses  on  critical  skills  can 
also  be  obtained  from  these  data  by  analyzing  fac- 
tors such  as  gun  time  versus  hits  (efficiency)  and 
actual  hits  versus  theoretical  hits.  The  later 
measure  may  be  a good  indicator  of  gunnery  skills 
and  a good  discriminator  between  pilots  (see  pilot 
1 versus  pilot  8,  in  Figure  6.1-10). 
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0.47 

%a 

24)7 

0.71 
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FIGURE  6,1-10  AVERAGE  VALUES,  OVERALL  MEANS  AND  STANDARD  DEVIATIONS  FOR  PERFORMANCE  MEASURES  USED 
IN  AV-8A  SIMULATIONS 
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PILOT 
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Tl 
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PI 
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13M 
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3.63 
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P2 
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66.27 
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OJll 

0.600 

263J 

4J6 
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231.6 

3.01 

7.U 

57.94 
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DEVIATION 

0.0U 

0J62 

102J 

U8 

3.49 

7,98 

FIGURE  6.M1  AVERAGE  VALUES,  OVERALL  MEANS  AND 
STANDARD  DEVIATIONS  FOR  PERFORMANCE  MEASURES 
USED  IN  HIGH  ACCELERATION  FIGHTER  (HAF)  STUDY 
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203.2 

7.69 

4U8 

97.7 
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49.9 
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2542 
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FIGURE  6.1-12  AVERAGE  SCORES,  OVERALL  MEANS  AND 
STANDARD  DEVIATIONS  FOR  PERFORMANCE  MEASURES 
USED  IN  THE  VECTORED  LIFT  FIGHTER  (VLF)  SIMULATION 
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14J7 

0.091 

MEAN 

2.99 

343 

1140 

0.054 

STANDARD 

DEVIATION 

0.95 

1.55 

346 

0.032 

FIGURE  6.1-13  AVERAGE  SCORES,  OVERALL  MEANS  AND 
STANDARD  DEVIATIONS  FOR  PERFORMANCE  MEASURES 
USED  IN  THE  ADVANCED  FIGHTER  TECHNICAL  INTEGRATION 
(AFTI)  SIMULATION 


Because  of  the  constraints  of  the  simulation 
studies,  subject  groups  were  highly  limited  in  size. 
Differences  in  aircraft  capability  and  study  design 
prevented  our  summing  over  subjects  to  generate  a 
sample  size  adequate  for  meaningful  statistical 
inference.  Attempts  were  made  to  apply  multiple 
regression  techniques  to  the  data;  however,  no 
meaningful  results  were  obtained  except  to  identify 


pilots  as  a significant  factor  in  predicting  overall 
performance.  This  means  that  a significant  amount 
of  the  variability  in  the  scores  can  be  attributed 
to  individual  differences  in  the  pilots.  The 
variability  inherent  in  this  set  of  scores  and  the 
small  sample  size  effectively  prohibited  further 
analysis  of  these  data. 
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FIGURE  6.1-14  RANK  ORDERING  OF  PILOT  PERFORMANCE 
ON  SELECTED  PROFICIENCY  MEASURES  FOR  AV-8A 
SIMULATION 


6 . 1 . 5 . 5 Performance  on  the  NASA  Differential 
Maneuvering  Simulator  - To  date,  over  15D  pilots 
have  been  used  in  tests  run  in  the  Differential 
Maneuvering  Simulator  (DMS).  Pilots  are  typically 
run  in  groups  of  four  with  a completely  balanced 
design  directed  at  evaluating  one  or  two  design 
parameters  for  a given  aircraft.  The  simulation 
group  at  NASA  made  available  to  us  performance 
data  on  12  pilots  flying  a lightweight  fighter 
type  aircraft  using  the  most  recent  on-line  gun 
and  missile  programs.  The  data  come  from  equivalent 
aircraft  baseline  runs.  In  addition  to  kills  and 
losses,  summary  data  were  available  for  three  non- 
weapons-orientod  dependent  variables  routinely  used 
by  NASA  to  evaluate  pilot  performance:  time-on- 
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offense  (TO);  time-on-offense  with  advantage  (TOA) 
(Beasley  and  Beissner,  1974);  and  a composite  AML 
score* ^ (see  Figure  6.1-15). 


PILOT 

TIME  ON 
OFFENSE' 

TIME  ON  OFFENSE 
WITH  ADVANTAGE' 
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KILLS' 

LOSSES' 

1 
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5,2 
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n.6 
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3 

1 

e 

50.5 

30,2 

4J 

1 

4 

7 

99J 

20.9 

5J 

4 

0 

t 

91,2 

1141 

4.6 

0 

3 

9 

62,0 

15,3 

54) 

3 

6 

10 

79J 

34,5 

5.0 

7 

0 

11 

60,2 

16,2 

4i 

1 

4 

12 

»U 

35,3 

5J 

3 

4 

MEAN 

01.00 

29J0 

5,22 

34 

34 

STANDARD 

DEVIATION 

20,42 

16.00 

0,56 

2J1 

2.43 

'AVERAGE  12  ENCOUNTERS 

FIGURE  6.1-15  MEAN  SCORES,  OVERALL  MEANS  AND 
STANDARD  DEVIATIONS  FOR  PERFORMANCE  MEASURES 
USED  IN  NASA  DIFFERENTIAL  MANEUVERING  SIMULA- 
TOR. LANGLEY,  VIRGINIA 

These  data  represented  a sample  large  enough 
to  yield  meaningful  statistical  analysis  and  were, 
therefore,  used  to  evaluate  the  reliability  of  the 
DMS  measures.***  For  each  measure  a split-half 
reliability  coefficient  (see  Figure  6.1-16)  and 
the  standard  error  of  measurement  based  on  six 
trials  were  calculated.  Using  these  values,  if  the 
simulation  were  repeated,  the  number  of  kills  per 
man  for  a set  of  six  trials,  should  not  differ  by 
more  than  one  85%  of  the  time.*^  Put  another  way, 
the  odds  of  having  a score  on  a repeated  simulation 
which  differs  from  the  present  score  by  more  than 
one  are  5:1  against.  For  the  AMLS  data,  the  odds 
against  having  a score  on  a replication  which  dif- 
fers by  ♦ .5  are  better  than  20:1.  The  JO  and  TOA 
measures  are  far  more  variable  and  do  not  appear 
to  be  reliable  discriminators  of  individual  perfor- 
mance, given  the  relatively  small  sample  size  used 
in  these  studies  (six  runs).  These  measures  are 
also  general  indicators  of  pilot  capability  with  an 
implied  relationship  to  the  ultimate  criterion. 
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i.e.,  kills.  The  AMLS  measure  correlates  well  with 
kills  (r  = .79);  and  as  a measure  of  positional 
advantage,  it  is  also  a good  indicator  of  the  pi- 
lot's flying  capability  relative  to  the  position 
and  flying  capability  of  his  opponent.  It  is  impor- 
tant to  note  that  high  AMLS  scores  (eight  or  better 
for  a given  one  second  interval)  usually  indicate 
that  you  are  in  or  near  a firing  position.  The 
AMLS  presents  a reasonable  alternative  to  kills. 

Such  alternatives  are  often  required,  especially 
when  using  dissimilar  aircraft  where  the  inferior 
aircraft  can  achieve  few  if  any  kills.  This  type 
of  situation  occurred  several  tiroes  during  the 
MACS  simulations  forcing  the  use  of  a nonkill  cri- 
terion to  evaluate  the  outcome  of  a simulation. 

Our  analysis  indicates  that  both  direct  (kills) 
and  indirect  (AMLS)  measures  exist  which  can  reli- 
ably measure  pilot  capability  in  a simulator. 


* ^Time-on-offense  consists  of  the  cumulative 
time  during  a run  when  a pilot  has  the  opponent's 
aircraft  in  front  of  his  aircraft's  wing  line. 
Time-on-offense  with  advantage  adds  the  additional 
restriction  that  the  pilot  is  behind  the  opponent's 
wing  line  (in  his  rear  hemisphere).  This  index 
provides  an  offense-and-not-defense  indicator  (you 
can  potentially  shoot  him  but  he  can't  shoot  you). 
The  AMLS  is  based  on  the  logic  of  the  AML  model 
mentioned  previously  (Burgen,  Fogel  and  Phelps, 
1975)  and  represents  the  average  of  the  summed 
scores  of  the  maneuvering  decision  criterion  which 
is  obtained  every  second.  This  was  developed  in 
the  AML  model  to  indicate  relative  positional 
advantage  between  aircraft.  A description  of  the 
model  and  this  decision  criterion  are  given  in 
Appendix  6.B. 

*‘*Scores  were  taken  on  a by-mission  basis  using 
equal  aircraft  and  a neutral  starting  condition. 

All  groups  of  four  pilots  flew  a balanced  set  of 
24  runs,  where  each  pilot  flew  two  runs  against 
every  other  pilot  in  the  group  and  used  both  DMS 
spheres.  This  yielded  a total  of  six  runs  per 
pilot  for  each  simulator  sphere  and  provided  the 
sample  of  performance  and  a balanced  test  design 
required  to  evaluate  the  capabilities  of  the  pilots 
in  a completely  fair  manner. 

*^The  reliability  coefficient  is  an  index  of  how 
well  you  are  measuring  what  you  want  to  measure. 

It  represents  the  amount  of  variance  in  the  second 
score  which  can  be  accounted  for  by  knowing  the 
first  score.  The  error  of  measurement  is  based  on 
the  degree  of  correlation  (the  value  of  the  relia- 
bility coefficient)  between  the  two  sets  of  scores 
and  is  an  estimate  of  how  close  you  will  come  to 
the  same  score  if  you  repeated  the  measurement. 

For  example,  you  will  obtain  a score  within  a range 
of  one  standard  error  68%  of  the  time  and  within 
+ two  standard  errors  95%  of  the  time. 
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FIGURE  6.M6  RELIABILITY  COEFFICIENTS,  MEANS,  STANDARD 
DEVIATIONS  AND  STANDARD  ERROR  VALUES  FOR  THE  SPLIT 
HALF  RELIABILITY  TESTS  OF  THE  DATA  GENERATED  IN  THE 
NASA  DMS 


6. 1.5. 6 Utilization  of  Performance  Measures 
to  Discriminate  between  Pilots  - These  measures  can 
also  be  used  to  discriminate  among  pilots.  Review- 
ing the  data,  we  find  large  differences  in  indivi- 
dual performance  for  kills,  losses  and  AMLS  measures 
(see  Figure  6.1-17).  Using  the  reliability  coeffi- 
cients generated  for  these  measures,  it  is  possible 
to  estimate  the  probability  that  different  scores 
could  represent  the  same  level  of  pilot  capability, 
and  all  differences  in  scores  are  measurement  errors. 
Evaluating  the  data  we  found  the  probability  of 
the  scores  being  random  error  is  approximately 
one  in  27,900  when  comparing  the  two  highest  and 
the  four  lowest  kill  values.^®  Similar  values 
are  obtained  for  the  highest  and  lowest  scores  on 
the  other  measures,  although  the  differences  in  some 
cases  are  between  different  pilots.  While  this  can 
be  a serious  problem  in  selecting  the  proper  cri- 
teria to  evalute  the  pilots,  this  particular  set 
of  data  shows  a clear  superiority  for  the  two  top 
pilots.  It  would  be  difficult  to  make  a reliable 
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estimate  of  which  of  these  two  was  the  "best,"  but 
this  would  be  true  of  almost  any  measure  of  indivi- 
dual capability  where  two  individuals  are  nearly 
evenly  matched.  Using  these  data  for  selection, 
two  of  twelve  pilots  are  clearly  superior,  and 
four  of  twelve  are  poor  risks.  Based  on  this  sim- 
ple simulation  exercise,  about  18'X  of  the  pilot 
population  could  be  selected  as  superior  in  ACM  and 
2S%  as  inferior.  Considerable  refinement  is  neces- 
sary before  a final  test  of  capability  could  be 
defined;  however,  the  data  generated  indicate  that 
such  a test  would  be  quite  feasible. 
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FIGURE  6.1-17  RELATIVE  PERFDRMANCE  BY  KILL  LDSS 
RANKING  AND  AMLS  MEASURES.  STANDARD  DEVIATIDN 
AND  STANDARD  ERRDR  DF  MEASUREMENT  ARE  INDI- 
CATED TD  ILLUSTRATE  THE  PDTENTIAL  CHANGES  IN 
SCDRES 


'*’A  new  standard  error  (SE)  of  measurement  was 
generated  based  on  the  standard  deviation  of  the 
average  scores  (per  six  trials)  for  each  pilot. 

Based  on  the  distribution  of  standard  errors, 
scores  greater  than  ^2.77  standard  errors  will 
only  occur  once  in  every  167  times.  Using  this 
value  and  the  SE  of  .54  found  for  this  sample, 
pilots  A and  B will  achieve  kill  scores  of  roughly 
2.0  only  once  in  every  167  times.  By  the  same  logic, 
subjects  1,  J and  K will  achieve  scores  as  high  as 
2.0  with  the  same  frequency.  The  probability  of 
both  these  occurring  in  the  same  sample  by  chance 
alone  is  about  1 in  27,900  indicating  a high  prob- 
ability that  the  higher  scorers  and  the  lower  scorers 
have  truly  different  capabilities. 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


MCOOMMELL.  0OL/C<->aS 


com^omM  T04»M 


6.1.6  The  Validity  of  Air  Combat  Maneuvering 
Simulators  as  a Measuring  Tool  for  Air  Combat  Pro- 
ficiency - Like  reliability,  there  are  two  impor- 
tant aspects  of  validity  as  they  pertain  to  simula- 
tors; does  the  simulator  fly  like  the  actual 
aircraft  (mechanical  validity)  and  are  the  better 
fliers  the  high  scorers  in  the  simulators  (opera- 
tional validity).  The  best  measure  of  this  would 
be  performance  in  combat  which  matched  performance 
in  the  simulator.  Achieving  this  kind  of  validity 
requires  an  extensive  aerial  conflict  on  the  level 
of  World  War  II  or  Korea.  Vietnam,  despite  all 
its  aerial  activity,  had  only  limited  air-to-air 
combat,  and  opportunity  became  a significant  issue. 
The  next  level  of  validity  would  be  a comparison 
between  simulator  performance  and  performance  in  the 
ACMR/I.  Due  to  the  recent  completion  of  these 
facilities,  data  relating  simulators  and  the  ACMR/I 
are  very  scarce.  The  data  that  do  exist,  however, 
will  be  evaluated  in  connection  with  both  flight 
tests  and  the  ACMR/I. 

6. 1.6.1  The  Mechanical  Validity  of  the  Simu- 
1 ati on  - Designers  of  the  simulations  discussed 
in  this  section  have  taken  great  effort  to  ensure 
that  they  are  mechanically  valid,  that  is,  they 
have  the  same  control  and  flying  characteristics 
as  the  aircraft  they  represent  within  the  limits 
of  the  simulator  mechanization  and  software.  The 
techniques  used  for  refining  the  control  feel  and 
flying  characteristics  of  the  simulator  incorporate 
a mixture  of  objective  engineering  and  subjective 
pilot  opinion.  The  objective  data  usually  are 
generated  by  extensive  flight  test  programs  and 
provide  a baseline  approximation  of  the  flying 
characteristics.  This  baseline  is  then  fine-tuned 
by  experienced  pilots  to  produce  a system  which 
flies  and  feels  exactly  like  the  aircraft.  A good 
example  of  how  this  refining  process  is  accompli- 
shed is  documented  by  Captian  S.  K.  Rust  in  his 
article  on  Simulator  Fidelity  Assurance  (1975)  which 
deals  with  the  system  validation  of  ASUPT  at 
Williams  Air  Force  Base,  Arizona. 


"The  first  problem  was  input.  In  fact,  there 
are  a lot  of  holes  in  the  available  aerodynamic 
data  for  the  T-37B,  particularly  in  the  stall, 
post-stall,  spin,  and  control  loading  areas. 
Much  of  the  basic  aerodynamic  data  came  from 
the  T-37A,  which  is  a slightly  different  model 
with  different  aero  characteristics.  To  fill 
in  these  data  gaps  (basically  areas  where  the 
fidelity  of  simulation  was  unsatisfactory) 
the  simulator  was  "tweaked"  (as  has  been  done 
with  every  simulator  that  1 know  of).  The 
tweaking  game  has  three  players,  the  pilot, 
the  contractor,  and  the  simulator.  Pilots 
tweak,  or  fine-tune,  the  simulator  to  make  it 
feel  or  respond  like  the  aircraft.  For 
instance,  if  aileron  stick  force  at  low  air- 
speed is  too  heavy,  a coefficient  can  be 
changed  to  adjust  it.  These  pilot  suggested 
changes  (called  tweaking)  are  a 50/50  deal  at 
best.  While  the  pilot  is  tweaking  the  simula- 
tor, the  simulator  is  tweaking  the  pilot. 

For  example,  a pilot  climbs  into  the  simulator 
and,  for  a given  airspeed  (230K),  the  aileron 
stick  force  for  a given  stick  deflection  is 
too  heavy;  let's  say.  it  is  five  pounds  heavier 
than  it  should  be.  So  the  pilot  says,  'Aileron 
is  too  heavy. ' 

"The  contractor  (who  is  on  the  simulator's 
side)  says,  'Are  you  sure?  Our  data  shows 
that  the  simulator  is  matched  exactly  to 
the  aircraft. ' 

"Pilot  says,  'No,  I'm  sure  it's  too  heavy.' 

"Contractor  says,  'OK,  I'll  change  it,  but 
I know  what  we've  got  in  there  meets  the 
test  guide.'  With  that,  he  changes  the 
force  so  it  is  only  three  pounds  too  heavy. 

The  pilot  flies  the  device  and,  lo  and  behold, 
it  really  feels  a lot  better;  still  not  quite 
right,  but  just  a little  too  heavy. 

"So  the  contractor  decreases  it  to  two  pounds 
too  heavy.  The  pilot  again  flies  and  says. 

'I'm  pretty  sure  that's  right.' 

"Now  what  happens?  The  pilot  goes  home, 
sleeps,  flies  the  aircraft  early  in  the 
morning,  comes  in  that  afternoon  to  work  on 
a different  problem,  jumps  in  the  simulator 
and  takes  off.  The  pilot  calls  the  contrac- 
tor and  says,  'Hey,  this  thing  is  really 
mixed  up.  Why  did  you  increase  the  aileron 
force  again?'  So  now,  the  contractor  is 
wondering  if  the  pilot  has  got  his  landing 
gear  on  straight  and,  instead  of  decreasing 
the  aileron  force  when  requested, he  increases 
it  to  see  if  the  pilot  can  really  tell  thV 
difference  . . . and  the  tweaking  games  go  on. 
It's  very  inefficient,  but  currently  it's  the 
only  way  to  fill  the  data  gaps."  (Rust,  1975, 

p.  108) 
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A number  of  problems  exist  with  this  technique 
due  to  the  subjective  nature  of  the  "it  feels  right" 
response.  Pilots  should  shuttle  between  the  "real" 
and  simulated  cockpits  to  ensure  they  stay  in  touch 
with  a proper  reference  point.  In  addition,  the 
reactions  of  "new"  pilots  should  also  be  solicited 
as  with  simulator  practice,  a given  pilot  loses 
sensitivity  to  the  differences  between  the  aircraft 
and  the  simulation.  These  and  the  problems  of 
identifying  subtle  but  important  miscues  in  the 
simulator  are  the  greatest  problems  with  subjec- 
tively refining  the  system.  Once  again.  Rust's 
own  experience  provides  a first  hand  example  of  the 
process. 


"However,  after  a period  of  time  our  ability 
to  detect  small  control  discrepancies  was 
limited  because  both  John  and  I could  fly  the 
simulator  very  precisely  the  way  it  was. 
Therefore,  John  and  I would  fly  with  new  IPs 
occasionally  to  observe  their  performance  and 
to  record  their  comments.  We  then  interpreted 
this  information  to  the  contractor,  and  even- 
tually got  the  simulator  to  perform  closer 
and  closer  to  the  real  aircraft. 

"One  of  the  most  complex  problems  we  ran 
into  was  correlation  of  the  different  sen- 
sory cues  to  which  a pilot  is  attuned. 

Control,  feel,  motion,  visual,  g-seat 
and  aural  cues  must  all  be  provided  to  the 
pilot  very  accurately.  None  of  these  com- 
ponents works  alone,  and  most  can't  be  eval- 
uated separately.  For  instance,  it  is 
extremely  difficult  to  evaluate  control 
loading  if  motion  is  giving  incorrect  cues. 
Incorrect  motion  cueing  causes  abnormal  con- 
trol inputs;  abnormal  control  inputs  magnify 
the  motion  problem,  etc.  Now  a cue  may 
detract  from  the  total  simulation  in  two 
ways  --  one,  if  it's  an  inaccurate  cue,  or 
two,  if  it  occurs  at  the  wrong  time." 

(pp.108-109). 


Similar  procedures  and  problems  were  found 
with  the  validation  of  the  other  simulators  studied. 
In  these  cases  where  the  aircraft  represented  a 
concept  rather  than  hardware,  existing  baseline 
aircraft  software  was  modified  to  incorporate  the 
new  maneuvering  capabilities.  The  pilots  then 
"tweaked"  the  system  to  produce  the  best  handling 
characteristics  possible,  within  the  constraints 
of  the  design  concept.' 
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Validation  studies  have  concentrated  on  pilot 
performance  with  respect  to  the  aircraft  flight 
envelope  and  the  maneuvers  performed  during  ACM, 
rather  than  comparisons  of  individual  pilot  capa- 
bility on  both  the  simulators  and  the  ranges. 

These  data  provide  indirect  evidence  of  simulator 
validity,  in  that,  if  the  aircraft  are  performing 
equivalent  maneuvers,  the  pilots  are  operating  the 
same  way  in  both  situations.  This  is  only  secon- 
dary validation,  as  the  question  of  whether  the 
pilots  would  perform  as  well  in  both  situations  is 
still  unanswered. 

A three-phase  study  was  conducted  to  establish 
the  validity  of  the  NASA  DMS.  The  first  phase 
consisted  of  replications  of  the  aircraft  evalua- 
tion flight  test  on  the  simulator,  comparing  simu- 
lated aircraft  response  with  flight-test  results. 

The  results  of  this  test  showed  a good  match  be- 
tween plots  of  the  flight  test  data  and  the  simu- 
lator aircraft  responses  for  most  of  the  aerodynamic 
characteristics  (Meintel,  et  al^,  1973). 

The  second  phase  related  to  the  aircraft  feel 
while  performing  a series  of  tracking  maneuvers. 

A comparison  of  these  tracking  maneuvers,  as  shown 
in  Figure  6.1-18,  indicated  good  agreement  between 
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the  simulator  runs  and  the  results  obtained  from 
the  fl ight  program. 

The  third  phase  of  the  validation  was  to  con- 
duct an  experimental  program  to  evalaute  the  rela- 
tionship between  flight  and  simulated  ACM.  The  Air 
Force  conducted  a study  in  1967  to  generate  ACM 
data  to  serve  as  a comparison  for  simulations  of 
air-to-air  combat.  This  program,  "Combat  Hassle" 
(Krajeck,  1968)  consisted  of  a series  of  one-on-one 
air  combat  engagements  between  two  aircraft,  one  of 
which  had  its  thrust  capabilities  limited  to  two- 
thirds,  one-third  or  military  thrust.  This  para- 
metric study  was  repeated  in  the  DMS  and  the  results 
were  compared  with  the  "Combat  Hassle"  data.  The 
probability  of  conversion  (putting  the  sight  on  the 
target)  as  a function  of  thrust  is  shown  in  Figure 
6.1-19.  As  can  be  seen  from  the  figure,  the  rela- 
tive results  are  in  quite  good  agreement. 


FIGURE  6.1-19  PROBABILITY  OF  CONVERSION  BY 
STANOARD  AIRCRAFT  AS  A FUNCTION  OF  TARGET 
THRUST  LEVEL 


The  three  phase  validation  program  seen  on  the 
DMS  lead  to  the  conclusion  that,  ",  . . current 
fighter  aircraft  can  be  represented  with  useful 
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accuracy,  and  pilot  operation  in  the  simulator  can 
be  meaningfully  compared  in  a similar  operation  in 
flight.  The  results  of  a research  type  study  con- 
ducted in  the  simulator  compare  favorably  with 
flight  results."  (Meintel,  et  1973,  p.  17) 

A similar  validation  was  performed  for  the 
McDonnell  Douglas  F-15  simulation  using  flight  test 
data  from  ACMR,  and  Edwards  AFB,  California 
(Jacezko,  1976).  These  flight  tests  consisted  of 
a limited  number  of  one-on-one  mock  air  combat 
engagements  between  the  F-15  and  other  aircraft. 

A comparison  of  several  aircraft  parameter  measures 
are  shown  in  Figure  6.1-20.  Good  agreement  is 
shown  between  the  simulator  and  flight  test  data. 
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FIGURE  6.1-20  COMPARISON  OF  SIMULATOR  ANO  FLIGHT 
TEST  FLIGHT  PROFILES  FOR  SELECTED  MEASURES 


An  even  more  striking  demonstration  of  simula- 
tor validity,  with  respect  to  flight  performance,  ^ 
occurred  during  the  "Streak  Eagle"  time-to-climb  , 
program  in  which  several  climbing  records  were  set.^ 
Due  to  simulator  inputs,  the  original  flight  pro- 
file for  the  time-to-climb  record  flight  was  modi- 
fied into  the  profile  actually  used  in  setting  the 
record  (see  Figure  6.1-21).  The  actual  times  to 
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reach  specific  altitude  barriers  were  also  predicted 
by  the  simulator  with  remarkable  accuracy  (see  Figure 

6.1-22). 


The  limited  data  available  directly  comparing 
flight  tests  and  simulators  appears  to  strongly  sup- 
port the  validity  of  the  simulator  with  respect  to 


FIGURE  6.1-21  ORIGINAL  AND  SIMULATOR  MODIFIED 
TIME-TO-CLIMB  FLIGHT  PROFILES 
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FIGURE  6.1-22  COMPARISON  OF  SIMULATOR  PREDICTIONS 
AND  ACTUAL  TIME-TO-CLIMB  TO  AN  ALTITUDE 


the  flight  performance  characteristics  of  the  air- 
craft and  to  some  extent  the  maneuvering  character- 
istics during  aerial  combat  engagements.  A signif- 
icant amount  of  work  is  needed,  however,  relating 
specific  pilot  capabilities  from  the  simulator  to 
actual  flight.  The  advent  of  the  instrumented 
ranges  at  Yuma  and  Nellis  opens  up  the  possibility 
of  such  comparisons  in  a cost  effective  manner. 
These  ranges  will  be  discussed  in  Section  6.2. 
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6. 1.6. 2 Validity  of  the  Simulator  with 
Respect  to  Pilot  Performance  - The  problem  of  per- 
formance validity  is  much  harder  to  deal  with  than 
the  problem  of  system  validity.  Not  only  is  there 
no  actual  combat  against  which  to  evaluate  simula- 
tor performance,  there  is  very  little  organized 
data  to  evaluate  with  respect  to  the  simulators 
themselves.  Most  simulation  experiments  do  not 
record  tlie  flying  histories  of  the  pilots  used  as 
subjects. 

In  an  attempt  to  verify  the  relationship  be- 
tween pilot  capability  and  simulator  performance, 
performance  history  questionnaires  were  developed 
and  mailed  to  the  15  pilots  participating  in  the 
AV-8A  simulation.  Of  the  15  questionnaires  dis- 
tributed, 13  were  returned,  seven  for  the  friendly 
and  six  for  the  threat  pilots.  The  responses  to 
this  questionnaire  were  used  to  rank  the  pilots 
with  respect  to  their  total  flight  hours,  the  num- 
ber of  ACM  engagements  that  they  had  participated 
in,  and  the  number  that  they  had  won  (see  Figure 

6.1- 23).  These  values  were  then  compared  with  the 
rank  ordering  of  performance  for  the  Time  in  Enve- 
lope, Gun  Hits  and  Theoretical  Gun  Hits  measures 
obtained  in  the  AV-8A  simulation  (see  Figure 

6.1- 14).  A Spearman  Rank  Correlation  was  used  to 
make  these  comparisons  (Siegel,  1956). 


The  Spearman  Rank  Correlation  coefficients 
for  all  combinations  of  performance  measures  are 
shown  in  Figure  6.1-24.  Of  the  8 correlation 
coefficients  shown,  only  one  approaches  statistical 
significance,  the  hits  by  percent  wins  comparison 
for  the  friendly  pilots  (.683  where  significance, 

[<i  * .05]  is  equal  to  .714).'^  The  obtained  corre- 
lations coefficients  are  of  moderate  size  and  sev- 
eral would  be  significant  if  the  pilot  population 
on  which  they  were  based  were  larger.  While  these 
data  are  illustrative  of  the  kind  of  analysis 


'’the  significance  levels  (<t  = .05)  for  this 
statistic  for  an  "n"  of  six  and  seven  observations 
are  .829  and  .714,  respectively. 
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needed  to  evaluate  simulator  performance  and 
objective  indices  of  pilots  skill,  no  statistically 
meaningful  conclusions  can  be  made.  The  values  do 
indicate,  however,  that  future  analyses  of  this 
type  should  concentrate  on  the  relationship  between 
hits.  Time  in  Envelope,  and  the  estimated  percent 
of  previous  ACM  wins. 
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FIGURE  6.1-23  FLIGHT  HISTORY  AND  RELATIVE  PRO- 
FICIENCY OF  PILOTS  PARTICIPATING  IN  THE  AV-8A 
SIMULATION 


Short  of  actual  combat  validation,  the  ACMR/I 
appears  to  be  the  best  way  to  generate  data  on  a 
pilot's  ACM  capabilities.  While  it  is  possible 
to  approach  this  problem  from  a historical  perspec 
tive  and  generate  the  required  data  from  existing 
records,  this  approach  has  many  drawbacks.  Illus- 
trative of  these  drawbacks  are  the  difficulties 
encountered  in  analyzing  the  MACS  simulation  data 
(see  Section  6.1.5).  The  success  of  this  approach 
also  depends  on  detailed  records  of  ACMR/1  per- 
formance being  made  available  to  the  research 
team.  Plans  are  being  made  for  an  automated  data 
storage  and  retrieval  system  for  the  ACMR,  however 
at  present,  no  systematic  data  base  exists  for 
individual  pilot  performance  on  the  ACMR/I.  An 
alternative  approach  would  be  to  design  a special 
simulator  and  flight  test  program  which  would  get 
comparable  pilot  performance  measures  under  com- 
parable flight  conditions.  This  program  would 
have  to  conform  to  strict  mission  control  pro- 
cedures and  follow  an  outline  of  specific  confron- 
tation rules.  One  part  of  such  a program  is 
currently  being  carried  out  on  the  ACMI  at  Nellis 
Air  Force  Base.  This  program,  ACEVAL-AIHVAL  is 
a highly  controlled  series  of  air-to-air  engage- 
ments whose  purpose  is  to  evaluate  flight  tactics 
and  missile  concept  effectiveness.  A parallel 
program  using  a simulator  will  provide  the  kind  of 
data  necessary  to  better  evaluate  the  relation- 
ship between  flight  and  simulator  performance. 
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FIGURE  6.1-24  CORRELATION  BETWEEN  PILOT  PERFORM- 
ANCE MEASURES  FROM  THE  AV-8A  SIMULATION  AND 
INDEPENDENT  ESTIMATES  OF  PILOT  ACM  PROFICIENCY 
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6.2  AIR  COMBAT  MANEUVERING  RANGE/ INSTRUMENTATION 
The  results  of  the  Air  War  over  Vietnam  in 
the  late  60s  indicated  a need  for  some  type  of 
advanced  pilot  training  in  air-to-air  combat 
(Weapons  Systems  Evaluation  Group,  Red  Baron  II, 
1973a,  1973b).  Based  on  the  premise  that  the  best 
training  for  air  combat  was  flying  air  combat-like 
missions  in  a controlled  environment,  and  the  fact 
that  technological  advances  made  possible  the  real- 
time monitoring  of  such  missions,  the  Navy  Air 
Combat  Maneuvering  Range  (ACMR)  and  the  Air  Force 
Air  Combat  Maneuvering  Instrumentation  (ACMI)  facil- 
ities were  constructed.*®  These  facilities  provide 
aircrew  training  in  a realistic  but  controlled 
environment  in  which  the  student  can  repeatedly 
observe  the  effectiveness  of  simulated  weapons 
released  under  the  conditions  encountered  in  an 
air  combat  engagement.  The  system  tracks  aircraft 
operating  within  an  assigned  airspace,  and  computes 
and  displays  position,  attitude  and  weapons -re la ted 
parameters  of  the  aircraft.  These  are  presented  in 
real  time,  using  a three-dimensional  representation 
of  the  engagement.  This  display  can  be  monitored 
by  instructors  during  the  engagement  and  played 
back  later  to  the  pilots  to  identify  errors  in 
tactics  or  weapons  release.  The  facilities  provide 
the  capability  to  monitor  and  record  the  results 
of  a multi-aircraft  mock  combat  engagement  through 
the  use  of  a specially  instrumented  pod  mounted  on 
the  aircraft  and  strategically  placed  special 
ground  based  radar  tracking  stations.  Used  with 
aircraft  having  the  maneuvering  characteristics  of 
the  MIG,  this  system  allows  the  pilots  to  "hassle" 
with  aircraft  which  maneuver  like  the  enemy.  This 
is  done  in  an  environment  where  mistakes  are 
analyzed  and  reviewed  instead  of  buried'®.  While 
no  one  fully  equates  even  a realistic  training 
arena  with  the  stress  of  real  combat,  useful  flying 
skills  can  be  developed  which  will  improve  a pilot's 
combat  capability.  With  this  in  mind,  the  overall 
emphasis  of  the  facilities  is  to  train  for  accurate, 
real  time  weapon  envelope  recognition  capability 
during  ACM.  The  following  sections  describe  the 
basic  systems  advantages  and  limitations  of  both 
the  Navy  ACMR  and  the  Air  Force  ACMI. 
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6.2.1  Description  of  the  ACMR,  Yuma,  Arizona  - 
The  original  ACMR  was  installed  at  the  Marine  Corps 
Air  Station,  Yuma,  Arizona  and  became  operational 
in  December,  1973.  Full  utilization  was  not  reached 
until  early  1976  because  of  a lack  of  a full  com- 
plement of  airborne  instrumented  pods.*"®  This  system 
was  set  up  to  track  four  high-speed  aircraft  from 
altitudes  of  5,000  to  40,000  ft.  within  a 30-mile 
cylinder.  It  can  also  maintain  surveillance  on  an 
additional  12  aircraft  within  a 50-mile  diameter 
cyl inder. 


6. 2. 1.1  ACMR  Training  Modes  - Five  training 
modes  are  used  to  support  different  levels  of  pilot 
training.  These  modes  are  outlined  in  Figure  6.2-1. 
As  can  be  seen  from  the  figure,  these  modes  are 
based  on  an  orderly  progression  of  difficulty. 

This  progression  was  meant  to  assist  the  student  to 
develop  progressively  increasing  proficiency  in 
recognizing,  and  maneuvering  to,  the  weapons  launch 
envelope. 


6. 2. 1.3  ACMR  Functional  Subsystems  - The  ACMR 
consists  of  four  major  subsystems;  aircraft  instru- 
mentation subsystem  (AIS);  tracking  instrumentation 
subsystem  (TIS);  control  and  computation  subsystem 
(CCS);  and  display  and  debriefing  subsystem  (DDS). 
The  AIS  pod  replaces  a sidewinder  missile  on  one  of 
the  launch  racks.  This  subsystem  collects  data  on 


*®The  Ault  Committee  Report  (NAVAIR  SYS  COM, 

1969)  indicated  that  poorer  than  expected  air  combat 
performance  in  Southeast  Asia  was  primarily  due  to 
training  deficiencies  and  failure  to  recognize 
weapons  performance  boundaries  under  combat  stress. 
Formation  of  the  Navy  Fighter  Weapons  School  at 
Naval  Air  Station  Miramar  as  the  Navy  pilots' 
"graduate"  school  for  tactics,  weapons  and  ACM 
training  (The  Top  Gun  Program)  was  one  action 
resulting  from  these  findings.  As  another  action. 
Air  Test  and  Evaluation  Squadron  FOUR  (VX-4)  was 
requested  to  define  the  requirements  for  an  ACM 
test  range  (Johns  Hopkins  University,  1976). 

*®When  first  flying  against  the  F-5  aggressor 
aircraft,  the  new  F-4  pilots  typically  try  to  turn 
with  the  "enemy,"  despite  warning  to  NEVER  TRY 
TO  OUT  TURN  A MIG.  In  combat,  this  is  a poten- 
tially  fatal  error  in  judgement.  On  the  ACMR 
they  learned,  by  experience,  not  to  do  it. 

^®Tests  of  an  improved  production  pod  were 
made  in  late  1974,  but  the  full  complement  of 
pods  was  not  delivered  until  early  1976. 
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MODE 

CUE 

REQUIREMENTS 

1 

CONTINUOUS  TONE 
WHEN  IN  FIRING 
ENVELOPE 

AIRCRAFT  WITHIN  RULE-OF-THUMB 
WEAPONS  FIRING  ENVELOPE. 

2 

TONE  IF  PROPER 
LAUNCH  IS  EXECUTED 

ARCRAFT  WITHIN  RULE-OF-THUMB 
WEAPONS  FIRING  ENVELOPE. 
SCORED  ON  BASIS  OF  CORRECT 
LAUNCH. 

3 

CONTINUOUS  TONE 
WHEN  IN  FIRING 
ENVELOPE 

COMPUTED  WEAPONS  FIRING 
ENVELOPE  BASED  ON  CONTINUOUS- 
LY COMPUTED  AWCRAFT/MBSILE 
PARAMETERS. 

4 

TONE  IF  PROPER 
UUNCH  IS  EXECUTED 

COMPUTED  WEAPONS  FIRING 
ENVELOPE  BASED  ON  CONTINUOUS- 
LY COMPUTED  AIRCRAFT/MBSILE 
PARAMETERS.  SCORE  IF  LAUNCH 
IS  IN  ENVELOPE  AT  TIME  OF 
TRIGGER  PULL. 

5 

TONE  IF  PROPER 
LAUNCH  IS  EXECUTED 

MORE  COMPLEX  PROGRAM.  TAKES 
INTO  ACCOUNT  TARGET  MOTION. 
ALLOWS  DEFENSIVE  MANEUVERS. 
SCORE  ONLY  IF  "GOOD"  HIT  IS 
ACHIEVED.  HAS  DYNAMICS  OF  THE 
"REAL  WORLD.” 

FIGURE  6.2-1  THIS  FIGURE  LISTS  THE  FIVE  TRAINING 
MODES  USED  IN  THE  ACMR/I.  THEY  REPRESENT  AN 
ORDERED  PROGRESSION  IN  DIFFICULTY  FROM  ROUGH 
ENVELOPE  APPROXIMATION  TO  THE  BEST  ESTIMATE 
OF  HITS  WITHIN  THE  LIMITS  OF  ACMR/I  ACCURACY. 


aircraft  and  pilot  performance  and  transmits  it  to 
the  ground  via  an  air-to-ground  data  link.  These 
data  include  tracking  information,  weapons  selec- 
tion, radar  lock-on,  aircraft  attitude,  altitude, 
acceleration,  angle  of  attack,  and  airspeed. 

The  above  data  are  obtained  in  part  from  the 
TIS.  The  TIS  consists  of  a network  of  small,  sun- 
powered  units  controlled  by  a master  station.  The 
subsystem  is  capable  of  locating  aircraft  utilizing 
any  three  remote  stations.  A ground-to-air  link 
permits  crosstalk  between  the  pods  and  the  ground 
station.  A ground  link  also  connects  the  remote 
stations  with  the  main  CCS.  The  CCS  contains  the 
data  reduction  hardware  and  software  necessary  to 
determine  the  position  of  each  aircraft  on  the 
range  and  the  weapons  envelope  for  the  selected 
training  mode.  It  also  determines  whether  the 
range  safety  requirements  are  being  met  and  issues 
warnings  to  aircraft  violating  the  restrictions. 

The  CCS  also  provides  real-time  recordings  and 
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displays  both  inter-  and  intra-aircraft  parameters 
for  up  to  four  aircraft.  There  are  two  DDSs,  one 
at  Yuma  and  one  at  Miramar  Naval  Air  Station  in 
California.  These  facilities  contain  instructor 
monitoring  stations  with  real-time  displays  of  the 
status  of  all  the  aircraft.  The  displays  can  pre- 
sent both  an  alphanumeric  status  report  on  an  air- 
craft by  aircraft  basis  and  a number  of  special 
visual  representations  of  the  combat  area.  These 
include  an  out-of-the-cockpit  (pilot's  perspective) 
view  for  any  of  the  aircraft,  and  a 3D  representa- 
tion of  the  combat  as  a whole  centered  around  a 
selected  position  in  space.  The  latter  3D  view 
can  be  rotated  to  present  the  engagement  from  dif- 
ferent viewpoints.  The  same  capability  exists  for 
presenting  the  engagement  to  the  student  pilots 
during  off-line  debriefing  sessions.  The  purpose 
of  the  ACMR,  as  it  was  first  constructed,  was  to 
be  a training  facility.  It  was  not  intended  as  an 
instrumented  system  for  development  and  evaluation. 
The  potential  for  this  was  so  great,  however,  that 
the  system  was  rapidly  developed  into  an  evaluation 
facility  - often  at  the  expense  of  training  mis- 
sions. As  early  as  1974,  evaluations  of  the  effec- 
tiveness of  the  F-15  in  the  air  superiority  role 
were  conducted  at  the  ACMR.  These  data  were  also 
used  to  evaluate  the  accuracy  of  the  MACS  F-15 
simulation  with  respect  to  both  performance  and 
software  programs  (Jacezko,  1976).  Despite  the 
restrictions  of  the  ACMR  data  collection  system, 
it  was  a major  breakthrough  in  real-time  flight 
monitoring  and  the  only  system  then  available  able 
to  collect  interactive,  in-flight,  aircraft,  per- 
formance data. 

6.2.2  The  Air  Force  Air  Combat  Maneuvering 
Instrumentation  Facility  - The  Air  Combat  Maneuver- 
ing instrumentation  (ACMI)  is  essentially  an  im- 
proved and  technologically  updated  replica  of  the 
ACMR.  The  ACMI  became  operational  in  July  1976. 

It  provides  an  aircraft  control  and  real-time  dis- 
play capability  for  up  to  eight  high-activity  and 
12  low-activity  aircraft  engaged  in  ACM.  Like  the 
ACMR,  the  ACMI  was  designed  to  provide  a facility 
for  pilot  training;  however,  because  it  offered 
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the  best  available  system  to  document  ACM,^’  it  was 
selected  for  use  in  the  Air  Combat  Evaluation-Air 
Intercept  Missile  Evaluation  (ACEVAL-AIMVAL)  pro- 
gram. This  joint  Air  Force-Navy  program  will  eval- 
uate Air  Combat  capability  and  the  use  of  new  air 
intercept  missiles  for  the  F-14  and  F-15  aircraft 
against  the  F5A,  a MIG-1  ike  opponent. 

6.2.2. 1 General  System  Description  of  the 
A^MI  - The  ACMI  airspace  is  a cylinder  30  nautical 
miles  in  diameter  extending  from  approximately  5000 
feet  above  the  average  ground  level  to  40,000  feet 
mean  sea  level  located  on  the  Nellis  AFB  south 
ranges.  It  employs  a seven-station,  inertially 
aided,  multi-station  tracking  system  coupled  to  a 
computer  and  display  system  through  microwave  com- 
munication links.  Real-time  recordings  replayed 
through  remote  displays  at  the  training  base  pro- 
vide immediate  postflight  crew  debriefing  and 
analysis.  The  airborne  component  of  ACMI  is  a pod 
in  AIM-9  configuration  which  mounts  on  a standard 
launch  rail  providing  a transponder  for  the  multi- 
station system  and  data  link  for  transmission  of 
aircraft  attitude,  weapon  status,  and  barometric 
data  to  ground  computers.  Weapons  scoring  is  based 
on  missile  miss  distance  calculations  performed  in 
the  ground  computers  by  means  of  digital  simula- 
tions. The  system  accommodates  any  inventory 
Missile  configuration,  provided  suitable  firing 
signals  are  available  to  the  pod,  and  is  suitable 
for  use  with  F-4,  F-5,  F-8,  F-14,  F-15,  F-111,  A-4, 
A-6,  and  A-7  aircraft.  . 

The  basic  ACMI  is  organized  into  the  same  four 
subsystems  as  the  ACMR:  the  AIS  pod,  the  TIS,  the 
CCS,  and  the  DOS.  The  functional  arrangement  of 
these  systems  is  depicted  in  Figure  6.2-2. 


Point-to-point  and  air-to-ground-to-air  communica- 
tions are  provided  via  the  various  links  for  com- 
mand and  control  of  the  mission  exercises  and  data 
transmissions.^^ 

The  accuracy  of  ACMI  system  parameters  and  the 
range  of  the  dynamic  parameters  to  be  measured  are 
found  in  Figures  6.2-3  and  6.2-4,  respectively. 

6 . 2 . 2 . 2 Changes  in  ACMI  Instituted  for 
AIMVAL  - A missile  simulation  subsystem  (MSS)  and 
one  additional  DOS  were  added  to  the  basic  ACMI. 

The  MSS  allows  for  a doubling  of  the  simultaneous 
missile  launch  capability  to  a total  of  eight. 

The  extra  DOS  allows  for  necessary  separate  debrief- 
ing facilities  for  the  Red  (F-5E  pilots)  and  Blue 
(F-14  and  F-15  pilots)  Forces  and  offers  a backup 
control  DOS  during  primary  DOS  downtime. 

A number  of  additional  modifications  were  made, 
all  of  which  tend  to  increase  the  data  acquisition 
and  data  reduction  capability  of  the  ACMI.  In  gen- 
eral, these  modifications  consist  of  the  inclusion 
of  gun  firing  data  into  the  ACM,  increased  informa- 
tion channel  capacity  from  the  AIS  pods,  software 
to  calculate  missile  probability  of  launch  and  kill, 
an  additional  Sigma  9 computer,  and  an  expanded  data 
display  for  mission  status  monitoring  and  mission 
debriefing.  A comparison  of  ACMR  and  ACMI  changes 
is  summarized  in  Figure  6.2-5.  A comprehensive 
description  of  the  ACMI  facility  as  modified  for 
ACEVAL-AIMVAL  may  be  found  in  ACEVAL-AIMVAL  Test 
Plan  (1976,  Vol . III). 

6.2.3  ACMR/1  Evaluation  as  a Selection  and 
Performance  Measurement  Tool  - Pilot  opinions  of 
the  facility  as  a training  device  have  been  highly  ' 
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Seven  TIS  remote  tracking  stations  were  in- 
stalled on  the  Nellis  south  range  and  communicate 
with  the  master  station  on  Angel  Peak  through 
ground-to-ground  transceivers.  The  master  station 
communicates  with  the  CCS  via  microwave  data  links. 
Although  the  basic  ACMI  DDS  is  permanently  installed 
within  Building  102  at  Nellis  AFB,  the  CCS  and  added 
DOS  are  situated  in  vans  alongside  the  building. 


^'High-activity  aircraft  are  defined  as  those 
actually  engaged  in  ACM  for  which  all  position, 
maneuvering,  and  weapons  data  are  required.  Low- 
activity  aircraft  are  those  for  which  x and  y posi- 
tion information  only  is  required.  Provisions  for 
low-activity  aircraft  were  included  in  the  ACMI  to 
permit  up  to  eight  fighters  to  escort  up  to  12 
bomber  or  similar  strike  aircraft. 

"^The  preceding  descriptions  were  taken  from  the 
ACEVAL-AIMVAL  Final  Test  Plan.  Vol.  IV,  August  1976. 
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NELLIS  ACMI  SUBSYSTEMS  FOR  ACEVAL-AIMVAL  a.  ,0 


BACKUP  DDS 
IN  VAN 

DDS 

DISPLAY  1 DEBRIEFING 
SUBSYSTEM 

IfiS 

MISSILE  SIMUUTION 
SUBSYSTEM 
IN  VAN 

CCS 

CONTROL  & COMPUTATION 
SUBSYSTEM  IN  VAN 

TIS 


TRACKING  instrumentation] 
SUBSYSTEM 
AT  SEVEN  REMOTE 
GROUNO  STATIONS  ON 
THE  RANGE  AND  MASTER 
STATION  AT  ANGEL  PEAK 


AIS 


5,000  FT 
AGL 


AIRBORNE  INSTRUMENTATION 

SUBSYSTEM 

IN  A POD  ON  EACH 

AIRPLANE 


FIGURE  6.2-2  THE  FUNCTIONAL  ARRANGEMENT  OF  THE  NELLIS  ACMI  SUBSYSTEMS  AS  THEY  EXIST  FOR  THE  ACEVAL- 
AIMVAL  PROGRAM 


favorable,  especially  from  those  who  have  had 
experience  with  the  system.  Figure  6.2-6  lists 
some  of  the  general  comments  regarding  the  benefits 
of  ACMR/I  t>-aining  which  we  received  from  our  pilot 
questionnaire.  Of  the  pilots  who  responded  to  this 
question,  over  98%  had  favorable  comments. 


In  addition  to  a pilot  evaluation  of  the  util- 
ity of  the  ACMR/I  as  a training  tool,  we  specifi- 
cally asked  the  pilots  to  rate  the  facility  as  a 
tool  for  selecting  both  combat-effective  pilots 
and  those  pilots  who  would  not  be  combat-effective 
(see  Figure  2.8-1 ). 


In  reply  to  the  question  "Do  you  feel  the 
pilots  who  perform  well  in  the  ACMR/I  will  perform 
well  in  actual  air-to-air  combat?"  Sixty-five 
percent  of  the  combat  pilots  agreed  or  strongly 
agreed,  23  percent  had  no  opinion,  and  only  12  per- 
cent disagreed  or  strongly  disagreed.  In  answer  to 


the  question,  "Do  you  feel  pilots  who  perform 
poorly  in  the  ACMR/I  will  do  poorly  in  actual  air- 
to-air  combat?"  Fifty-four  percent  agreed  or 
strongly  agreed,  26  percent  had  no  opinion,  and 
20  percent  disagreed  or  strongly  disagreed.  These 
responses  indicate  highly  favorable  pilot  opinions 
of  the  ACMR/I  as  a selection  tool  for  combat  effec- 
tive pilots.  Pilot  opinion  also  indicates  that  the 
ACMR/I  may  be  useful  as  a tool  to  cull  out  those 
pilots  of  low  combat  effectiveness.  The  reserva- 
tions which  do  exist  in  both  of  these  areas  center 
around  some  of  the  basic  characteristics  of  the 
range.  Despite  the  utilization  of  actual  aircraft 
in  an  environment  of  high  speed,  interactive  maneu- 
vering, the  encounters  on  the  range  are  not  real 
combat.  At  best,  they  can  train  or  measure  whether 
a pilot  knows  what  to  do  and  if  he  is  capable  of 
doing  it.  There  is  no  technique  incorporated  into 
the  range  to  measure  whether  he  will  use  those 
capabilities  when  engaged  in  actual  combat.  This 
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ACMI  PARAMETRIC  DATA 

MAXIMUM  STANDARD 
DEVIATION  OF  ERROR 

1.  CLOSING  VELOCITIES  BETWEEN 
“FIGHTERS"  AND  "TARGETS"  (V^) 

35  FT/SEC 

2.  SLANT  RANGES  FROM  "TARGETS" 
TO  "FIGHTERS"  (AR) 

SOFT 

3.  ASPECT  ANGLE  (ASA) 

2 DEG 

4.  ASA  IN  WING  PLANE  OF  TARGET 
AIRPUNE  (ASA^) 

2 DEG 

S.ASA  IN  PLANE  PERPENDICULAR 
TO  WING  PUNE  OF  TARGET  AIR- 
PLANE (ASAy) 

2 DEG 

6.  AIRPLANE  DIVE  OR  CLIMB  ANGLE 
(D/CA) 

2 DEG 

7.  AIRPLANE  ANGLES  OF  ATTACK 
(AOA)  AND  SIDESLIP  ANGLES  (ASS) 

2 DEG 

«.  RATE  OF  CHANGE  OF  AOA 

2 OEG/SEC 

9.  AIRPLANE  NORMAL  ACCELERATION 

(N) 

OJ  "G" 

10.  ANTENNA  TRAIN  ANGLE  (ATA) 

2 DEG 

11.  ATA  IN  WING  PLANE  OF  FIGHTER 
AIRPLANE  (ATA^) 

2 DEG 

12.  ATA  IN  PLANE  PERPENDICULAR 
TO  WING  PLANE  OF  FIGHTER  AIR- 
PLANE (ATAy) 

2 DEG 

13.  AIRCRAFT  POSITION  COMPONENTS 
IN  RESPECT  TO  EARTH  COORDI- 
NATES («,  t,  z)  z SHALL  BE  ABOVE 
MEAN  SEA  LEVEL 

25  FT 

14.  RATE  OF  CHANGE  OF  z,  RATE  OF 
CLIMB  IRC) 

FT/MIN,000 

15.  AIRPLANE  CALIBRATED  AIR  SPEED 
(CAS) 

10  KNOTS 

16.  AIRPLANE  TRUE  AIR  SPEED  (TAS) 

15  KNOTS 

17.  AIRPLANE  MACH  NUMBER  (M) 

0.02  M 

10.  AIRPLANE  attitude  WITH  RE- 
SPECT TO  EARTH  COORDINATES 

2 DEG 

19.  AIRPLANE  VELOCITY  COMPONENTS 
«,  y,  A.vD  z 

15FTAEC 

20.  RATE  OF  N 

0.5"G"/SEC 

I NOTES: 

' I 1.  THE  ABOVE  STANDARD  DEVIATIONS  SHALL  NOT  BE 

• J EXCEEDED  FOR  AIRPLANE  AIRSPEEDS  BETWEEN  250 

" I FT/SEC.  A GRACEFUL  DEGRADATION  IN  ACCURACY 

, IS  ACCEPTABLE  FOR  AIRSPEEDS  BELOW  250  FTAEC. 

2.  PARAMETERS  HAVING  MATHEMATICAL  SINGULARI- 
TIES MAY  DEGRADE  GRACEFULLY  AROUND  THE 
SINGULARITIES. 

FIGURE  6.2-3  REQUIRED  ACCURACIES  OF  THE  ACMI 
MEASUREMENT  SYSTEM  RELATING  TO  THE  MEASURE- 
MENT OF  THE  AIRCRAFT  POSITION  IN  SPACE 
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ACCELERATION 

-2.5  TO  8.5  "G" 

AIR  SPEED 

lOOFT/^EC  TO  1.6  MACH 

ROLL  RATE 

0 DEGAEC  TO  360  OEG/SEC 

RELATIVE  VELOCITY 

OFT/SEC  TO  *4000  FT/SEC 

MINIMUM  MISSILE  FIRING  RANGE 

1000  FT 

MAXIMUM  MISSILE  FIRING  RANGE 

30,000  FT 

AIRPLANE  ATTITUDES 

ALL 

AIRPLANE  ALTITUDES 

5000  FT  TO  40,000  FT 

FIGURE  6.2-4  THIS  FIGURE  INDICATES  THE  AIRCRAFT 
DYNAMIC  RANGE  WITHIN  WHICH  THE  MEASURES  LISTED 
IN  FIGURE  6.2-3  WILL  OPERATE 


SUBSYSTEM  OR  FUNCTION 

AIR  COMBAT  MANEUVERMC 
RANGE  • YUMA.  AZ. 

AIR  COMBAT  MANEUVERING 
INSTRUMENTATION  > NELLIS  AFB  NEV. 

KANGE  SIZE 

30  MILECYLMDER 
TO  40.000  MIN1MX 
ALTITUDE 

30MIU  CYLmOCR 
5.000  TO  40.000  MIN  MAX 
ALTITUDE 

AIRCRAFT  CAPACITY 

4 FAST 
12SLOW 

IFAST 
12  SLOW 

RAOAR  TRACKING  STATIONS 

S 

? 

HCRS?T 

INSTRUMENTATION 

SUBSYSTEM 

AM  POO 

U BIT  TRANSUSSION 

TWTPOB 

% BIT  TRANSMISSION  INCREASED 
WEAPONS  SYSTEMS  USAGE  REPORTING 
CAPABILITY 

TRACKMC  INSTRUMENTATION 
SUBSYSTEM 

DATA  RATE  FOR 
04  BIT  TRANSMISSION 

ENLARGED  CAPACITY  TO  TRANSMIT 
NEW  DATA  RATE 

CONTROL  AND  COMMUNICATION 
SUBSYSTEM 

NO  PROBABILITY  OF  KILL. 
MANUAL  PAIRING  BY  RANGE 
TRAINING  OFFICERS. 

3 SIOM'S  COMPUTER 
PROCESSING  UNITS. 

PROBABILITY  OF  KILL  (Pk>  DATA. 
STOED  NISSILE  RELIABILITY 
USED  TD  CALCULATE  Pp(.  NEAREST 
AIRCRAFT  LINE  OF  SIGHT  WEAPONS 
PAIRING.  GENERATES  EXPANDED 
REASONS  FOR  MISS  DUCNOSTIC 
MESSAGES.  EXPANDED  COMPUTER 
CAPABILITY. 

t SIGMA-9  COMPUTER  PROCESSMC 
UNITS. 

DISPLAY  AND  DEBRIEFING 
SUBSYSTEM 

ONE  AT  YUMA 
ONE  AT  MIRAMAR 

TWO  AT  NELLIS -MFROVEO 
RETRIEVAL  AND  PLAYBACK  SYSTEM  - 
FOUR  FOOT  SQUARE  FOUR  COLOR 
BRIEFING  D6PLAY.  INCREASED 
CAPACITY  display  FOR  MBSION 
PARAMETER  INCLUDES  GUNS.  UP 
TD  EIGHT  MBSILES  ATATMM. 

FIGURE  6.2-5  THIS  FIGURE  LISTS  THE  DIFFERENCES 
BETWEEN  THE  ACMR  AND  ACMI  FACILITIES  AS  THEY 
ARE  CURRENTLY  CONFIGURED 
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drawback  to  the  ACMR/I  concept  was  the  one  most 
frequently  mentioned  by  the  fighter  pilots 
answering  our  questionnaire.^^  The  ACMR/I  must, 
therefore,  be  considered  as  a tool  to  measure  the 
necessary  conditions  for  becoming  a fighter  pilot  - 
the  what  to  do  and  how  to  do  it  aspects  of  air-to- 
air  combat.  The  question  of  whether  a man  will 
fight  must  be  determined  by  other  techniques. 
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QUESTION:  “WHAT  DO  YOU  THINK  ARE  THE  PRINCIPAL  BENEFITS  AND 
LIMITATIONS  OF  ACMR  TRAINING?” 

RESPONSES  REGARDING  ACMR/I  BENEFITS: 

MORE  REALISTIC  THAN  MOST  PEACETIME  TRAINING  - CHALLENGES 
THINKING  AND  SKILL.  THE  ONLY  MISSING  INGREDIENT  IS  LIVE  AMMO 
OVER  ENEMY  TERRITORY. 

THE  LIMITATIONS  SHOULD  HOT  BE  DECISIVE.  SOME  CANNOT  PERFORM 
THEIR  BEST  UNTIL  IT  IS  THE  ACTUAL  THING.  I REPEAT  AGAIN  - IT  IS 
THE  INDIVIDUAL  WHO  HAS  THE  HEART,  DESIRE  AND  WILL-TO-00. 

EXPOSES  PILOTS  TO  NEED  FOR  DETERMINATION,  ALFJiTNESS  AND  QUICK 
RLACTION  TO  A SITUATION  - THE  SITUATION  IS  ARTIFICIAL,  BUT  THE 
BEST  PRESENTATION  AVAILABLE  - PILOTS  MUST  TAKE  ADVANTAGE  OF 
THE  BENEFITS,  AND  ACCEPT  THE  LIMITATIONS.  PUT  REALISM  INTO  THE 
SCENARIOS. 

IT  TEACHES  A PILOT  HOW  TO  MANEUVER  HIS  AIRCRAFT  INTO  POSITION 
TO  KILL.  IT  ALSO  GIVES  A PILOT  THE  REAL  FEEL  OF  HIS  AIRCRAFT  AND 
HOW  IT  HANDLES.  THE  LIMITATIONS  ARE  THAT  REAL  BULLETS  ARE  HOT 
BEING  FIRED.  SOME  PILOTS  ARE  GOOD  IN  ACM,  BUT  THEY  CANNOT  FACE 
THE  REAL  THING. 

THE  SAME  LIMITATIONS  AS  ANY  TRAINING.  “IF  YOU  LOSE, YOUR  LIFE  IS 
NOT  AT  STAKE." 

IMPROVE  INDIVIDUAL  SKILLS,  LEARN  EQUIPMENT  LIMITATIONS,  ETC. 
UNFORTUNATELY,  A PILOT  'S  ABILITY  AND  AGGRESSIVENESS  VARIES 
CONSIDERABLY  WHEN  HE  IS  BEING  SHOT  AT,  AND  ACMR  IS  ONLY  OF 
LIMITED  EFFECTIVENESS  IN  DETERMINING  THIS  GOVERNING  CHARAC- 
TERISTIC. 

FIGURE  6.2-6  RESPONSES  TO  QUESTION  ON  THE  BENE- 
FITS OF  ACMR/I  TRAINING.  OF  THE  300  PILOTS  WHO 
RESPONDED  TO  THIS  QUESTION,  98%  INDICATED  THERE 
WOULD  BE  SOME  BENEFITS  FROM  ACMR/I  TRAINING 


A number  of  other  constraints,  beside  the  lack 
of  enemy  fire  and  the  resultant  emotional  response, 
are  present  in  the  ACMR/ I. These  constraints  are 
a function  of  the  artificial  characteristics  of  the 
test  environment  and  limitations  in  equipment  and 
software  capabilities.  A list  of  specific  range 
limitations,  their  cause,  and  the  effects  they  have 
on  air  combat  realism  is  detailed  in  Figure  6.2-7. 


Despite  these  drawbacks,  the  ACMI  provides  a unique 
facility  for  the  documentation  and  evaluation  of 
both  aircraft  and  pilot  capabilities  for  air-to-air 
combat. 
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RANC£  CONSTRAINT 

reason  for  constraint 

RESULTANT  LNMTATKMS 
WITH  RESPECT  TO  “REAL- 
AIR  COMBAT 

MANEUVERING  BOUNDARIES 

SIZE  OF  facility 

LMITEO  COMBAT  AREA 

MMIMUM  ALTITUDE  AND 
OPERATION  LMIITS 

safety 

UNREALISTIC  CONSTRAINTS 
TO  ALLONABU  COMBAT 
MOVEMENTS 

LMm  oN  AMcurr  ' 

MANEUVERS,  I.E„  OVER 
•*G” 

SAFETY 

LMTS  MANEUVERS  WHICN  MY 
BE  EIECUTED 

MtSSIU  AND  GUN  FIRE 
SIMUUTED 

NO  actual  weapons  can  be 

launched 

FEW  CUES  FOR  EITHER  AHACK- 
WCOROEFEKIVE  AWCNAFT 
CONCERNINC  REA  PONS  FIRING. 
(ATTACK  AIRCRAFT  DOES  NAVE 
SUCCESSFUL  MBSILE  LAUNCH 
INDICATOR' 

MNGE  SPECIFIC  SCENtRIO 

SPECIFIC  MEA,  EkHt 
HMCMFT.WOCRIIIMO  FM. 
VBIMl  W8TIF1CXTKWWLES 

is  CWt  ttOMIO  KCOKS 
SPECFC  TOXHUUIUT 
LMtra.cMM«T  eiiYm<m«T 

GUN  HIT  SIMULATKM  BASED 
ON  STATISTICAL  ANALYSIS 
OF  AIMING  ERROR  AND  PROB- 
ABILISTIC DISTRIBUTION 
OF  GUN  ROUNDS 

HBTRUMUTATION  LACKS 
ACCURACY  TO  MEASURE  BULUT 
HITS  ON  OPPONENT 

RO“TRUE“EST«ATESQF 
GUNFIRE  HITS 

PROBABILITY  OF  KILL  DATA 
BASED  ON  F4E.  NOT  F4S 



FUNOMC  LMTATANS  PRO- 
HWITEO  OEVELOPWC  PROPER 
PROBABILITY  OF  KILL  DATA 

APPROiainOM  FOR  all 

PROBABN.ITY  ESTHSTES 

FIGURE  6.2-7  LISTING  OF  MAJOR  CONSTRAINTS  OF  THE 
ACMI  AS  CONFIGURED  FOR  ACEVAL-AMIVAL  AND  THEIR 
EFFECT  ON  THE  REALISM  OF  THE  AIR  COMBAT  ENCOUNTER 


^’The  following  quote  is  an  illustrative  sample 
of  the  responses: 

"Some  pilots  are  good  in  ACM,  but  then  cannot 
face  the  real  thing." 

"I  think  it’s  great  training  - but  when  the 
guy's  life  is  at  stake  - will  he  still  perform 
as  well?  It's  like  putting  all  your  money  on 
a movie  character  in  an  actual  street  fight." 
^''This  is  best  summed  up  by  another  quote  from 
our  pilot  sample.  "It  (the  ACMR/I)  measures  the 
Head  and  Hands  accurately,  but  (you)  cannot  measure 
Heart  except  under  actual  combat  conditions." 

^^This  discussion  will  center  on  the  ACMI  as  it 
is  configured  for  the  ACEVAL-AIMVAL  tests.  This 
configuration  is  the  "best"  system  of  its  kind 
currently  operational. 
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6.2.4  Performance  Evaluation  on  the  ACMR/1  - 
The  ACMR/I  was  constructed  primarily  as  a training 
facility  for  air-to-air  combat.  As  such,  instructor 
pilots  reviewed  each  combat  engagement  with  the 
students  during  post-mission  debriefing  sessions. 

The  purpose  of  this  review  was  to  evaluate  perform- 
ance during  a mission  and  to  identify  and  analyze 
tactical  errors.  Data  on  kills,  misses  and  kill/ 
loss  ratios  were  evaluated,  but  the  emphasis  was 
on  analysis  of  tactical  errors  and  the  definition 
of  "best"  maneuvers. 

6. 2. 4.1  Time-Variant  Figure-of-Merit  as  a 
Measure  of  Air-to-Air  Combat  Performance  - In  an 
effort  to  define  an  objective  measure  of  pilot  per- 
formance, the  Naval  Air  Test  Center  at  Patuxent 
River,  MD,  the  Naval  Weapons  Center  at  China  Lake, 
CA,  and  the  Center  for  Naval  Analysis  in  Washington, 
D.C.,  have  cooperated  to  develop  a time-based 
figure -of -merit  as  a measure  of  performance  in  the 
ACMR/I  (Simpson,  1976).  This  technique  is  based  on 
continuously  calculating  a figure-of-merit  or  per- 
formance index  at  each  point  in  the  engagement. 

This  performance  index  uses  the  aircraft  parameters 
typically  measured  in  the  ACMR/I  (see  Figure  6.2-8) 
and  is  indicative  of  the  relative  advantage/dis- 
advantage at  a particular  time  in  the  engagement. 

The  index  is  derived  from  an  examination  of  the 
inter-airplane  angular  geometry,  distance  and 
dynamics,  and  an  evaluation  of  the  weapons  systems 
envelope.  It  takes  the  form  of:^'’ 

PI  = DAn|(l-F^)K  where 

PI  = performance  index 

DA^  * the  normalized  angular  geometry  resulting 
” from  the  combination  of  the  Angle  Off  Tail 
and  the  Antenna  Train  Angle  (See  Figure 
6.2-8). 

F » a penalty  derived  from  the  range  between 
’’  aircraft  and  effective  gun  or  missile 
range. 

K • a mathematical  function  describing  a posi- 
tive or  negative  weighting  function  for 
closing  rate,  dependent  on  the  weapons 
delivery  envelope  (both  guns  and  missiles). 


Overall,  the  highest  value  of  the  index  would 
occur  when  the  attacker  was  directly  on  the  tail 
of  the  opponent,  within  missile  or  gun  range,  and 
at  zero  closing  velocity.  In  a like  manner,  the 
worst  case,  a high  negative  value,  would  occur 
when  the  situation  was  reversed.  The  index  is 
valuable  in  that  it  provides  both  a summary  and  a 
time  history  plot  of  the  relative  positional  advan- 
tage of  the  aircraft. 
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1 PARAMETER 

DEFINITION  1 

1 AIRPLANE  PARAMETERS  | 

ANGLE  OFAnACK(AOA) 

ANGLE  BETWEEN  THE  FREE  STREAM 
FLOW  AND  THE  AIRPLANE  REFER- 
ENCE LINE 

NORMAL  ACCEURATION  (N,| 

THE  LOAD  FACTOR  TAKEN  PERPEN- 
DICULAR TO  THE  FLIGHT  PATH 

ALTITUDE  (ALT) 

GEOMETRIC  ALTITUDE  ABCVE  GROUND 
LEVEL 

mOICATEO  AIRSPEED  (IAS) 

AIRSPEED  MEASURED  BY  AIS  UNCOR- 
RECTED FOR  POSITION  ERROR 

SPECIFIC  ENERGY  (Ej) 

SUM  OF  THE  WEIGHT  SPECIFIC  KINETIC 
AND  POTENTIAL  ENERGIES 

TARGET  MACH  NUMBER  (MT) 



MACH  NUMBER  OF  THE  TARGET 
AIRPLANE 

INTER-AIRPLANE  PARAMETERS 

RANGE  (R) 

LINE  OF  SIGHT  DISTANCE  BETWEEN  THE 
CENTER  OF  GRAVITY  OF  TWO  AIRPLANB 

CLOSING  VELOCITY  (VC) 

TIME  RATE  OF  CHANGE  OF  RANGE 

ANTENNA  TRAIN  ANGLE  (ATA) 

THE  ANGLE  BETWEEN  THE  AIRCRAFT 
REFERENCE  LINE  FORWARD  OF  THE 
CENTER  OF  GRAVITY  AND  ANY  SIGHT 
LINE 

ANGLE  OFF  TAIL  (AOT) 

THE  ANGLE  BETWEEN  THE  AIRCRAFT 
REFERENCE  LINE  AFT  OF  THE  CENTER 
OF  GRAVITY  AND  ANY  SIGHT  LINE 

FIGURE  6.2-B  PRIMARY  AIR  COMBAT  MANEUVERING 
PARAMETERS.  THESE  MEASURES  INDICATE  THE  STATE 
OF  AN  AIRCRAFT  AND  THE  INTERACTIVE  SPATIAL 
RELATION  SETiEEN  THE  OPPONENT  AIRCRAFT 


^®A  complete  description  of  the  performance 
index  and  the. equations  used  to  derive  the  values 
of  DA^,  F , and  K can  be  found  in  Simpson  (1976). 
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As  a performance  measure,  the  index  has  a 
strong  relationship  to  the  AMLS  measure  developed 
by  the  NASA  simulation  group.  The  AMLS  represents 
the  sum  of  12  simple  binary  decisions  concerning 
the  state  of  the  two  opponent  aircraft  and  uses 
parameters  which  are  very  similar  to  those  used  in 
the  performance  index.  While  the  AMLS  is  typically 
treated  as  a summary  measure,  it  is  possible  to 
generate  the  same  type  of  engagement  time  history 
as  found  with  the  performance  index.  The  major 
difference  between  the  two  is  the  use  of  complex 
equations  relating  to  inter-airplane  spatial  relation- 
ships in  computing  the  performance  indices.  Both 
techniques  provide  potentially  valuable  scoring 
criteria  for  pilot  performance,  but  neither  tech- 
nique has  been  thoroughly  validated  against  more 
traditional  evaluation  criteria  such  as  kills  or  time- 
in-envelope.  Data  from  ACEVAL-AIMVAL  should  pro- 
vide the  kind  of  data  base  necessary  to  validate 
both  concepts. 

6. 2. 4. 2 ACEVAL-AIMVAL  Pilot  Performance 
Criteria  Definition  - ACEVAL-AIMVAL  had  as  its 
objectives  the  evaluation  of  the  effects  of  force 
mix  (the  number  of  aircraft  on  each  side)  and  the 
operational  utility  of  existing  and  proposed  short 
range,  air-to-air  missiles.  To  accomplish  this 
evaluation,  performance  criteria  have  shifted  from 
a subjective  analysis  of  the  missions  to  mission 
success  criteria  such  as  number  of  kills  and  kill/ 
loss  ratios.  These  kinds  of  objective  criteria  are 
necessary  for  an  unbiased  evaluation  of  the  mission 
parameters  under  investigation.  The  ACEVAL-AIMVAL 
Test  Plan  (ACEVAL-AIMVAL  TEST  PLAN.  Vol . II  and  III. 
1976)  details  a comprehensive  analysis  of  both  test 
and  control  variables  with  respect  to  weapons- 
oriented  dependent  variables.  A list  of  the  pri- 
mary variables  is  given  in  Figure  6.2-9.  These 
measures  are  used  to  derive  secondary  measures  of 
effectiveness  such  as  percent  kills  versus  firings 
and  firings  versus  opportunities.  They  are  also 
used  to  generate  descriptive  and  probability  of 
success  measures,  given  various  mission  factors. 

These  measures  (hits  as  a function  of  angle  off 
boresight,  firings  as  a function  of  first  sightings, 
time  to  fire  given  visual  ID)  serve  as  a means  of 
evaluating  tactics  and  missile  effectiveness  to 
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RADAR  DETECTION  RANGE  ! 

VBUAL  DETECTION  RANGE 

VISUAL  IDENTIFICATION  RANGE 

NUMBER  OF  RADAR  MBSILE  FIRINGS 

NUMBER  OF  INFRAWtED  MBSIU  FIRINGS 

NUMBER  OF  GUN  FIRINGS 

TOTAL  NUMBER  OF  FIRINGS 

NUMBER  OF  RADAR  MISSILE  KILLS 

NUMBER  OF  INFRAWLED  MBSILE  KILLS 

NUMBER  OF  GUN  KILLS 

TOTAL  NUMBER  OF  KILLS 

LOSS  RATE 

POSITION  - TARGET  ANGLE  OFF  BORESIGHT  AT  FIRING 
ASPECT  OF  TARGET  WHEN  FIRING 
RANGE  TO  TARGET  AT  FIRING 
TIME  INTO  MBSION  AT  FIRING 

FIGURE  6.2-9  LIST  OF  PRIMARY  DEPENDENT 
VARIABLES  USED  IN  ACEVAL-AIMVAL  TO 
EVALUATE  AIRCRAFT  PERFORMANCE  AND 
NEW  MISSILE  CONCEPTS 


generate  an  optimum  engagement  profile.  If  exe- 
cuted as  planned,  the  data  descriptions  generated 
from  ACEVAL-AIMVAL  will  provide  invaluable  documen- 
tation on  what  makes  a successful  encounter. 

This  plan  also  includes  a multiple  regression 
analysis  of  the  data.  This  technique  can  be  used 
to  identify  non-overlapping  factors  which  determine 
mission  success.  Thus,  the  analysis  may  find  that 
first  visual  detection,  range  to  target,  shots 
taken,  and  angle  off  are  all  independent  contrib- 
utors to  weapon  kills.  Data  of  this  type  are  crit- 
ical for  the  definition  of  both  selection  and  train- 
ing programs.  Having  identified  critical  skills  in 
an  operational  manner,  selection  programs  can  be 
tailored  to  evaluate  candidates  with  respect  to  the 
abilities  required  to  master  these  skills.  Where 
skills  can  be  acquired  or  refined,  training  packages 
can  be  designed  to  improve  pilot  capability.  As  a 
case  in  point,  let  us  consider  first  visual  detec- 
tion as  a critical  skill.  Pilot  opinion  rates 
seeing-the-enemy-first  as  a highly  important  part 
of  winning  in  the  air  combat  theater.  This  capabil- 
ity is  made  up  of  both  innate  and  trainable  char- 
acteristics. Visual  acuity,  or  more  precisely, 
the  ability  to  detect  slight  movement  or  glints, 
especially  in  the  periphery  of  the  visual  field,  is 
one  aspect  of  the  ability.  This  must  be  coupled 
with  good  central  acuity  to  determine,  at  maximum 
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range,  whether  the  detected  object  is  a friendly 
aircraft,  or  a target.  Additional  factors  such  as 
consistent  search  for  the  enemy  are  also  important 
to  detection. 27  Based  on  these  data,  selection 
tests  could  be  devised  to  measure  a candidate's 
capability  for  peripheral  target  search  and  detec- 
tion. This  same  characteristic  also  has  potential 
for  improvement  through  training.  A study  by 
Low  (1946)  indicates  that  training  can  increase 
peripheral  acuity  by  as  much  as  300%. 

This  specific  set  of  selection  and  training 
implications  of  the  ACEVAL-AIMVAL  data  analysis  is, 
of  course,  only  illustrative  of  the  kind  of  data 
applications  which  can  be  made.  Most  importantly, 
while  the  study  is  concerned  with  weapons  system 
effectiveness,  the  analysis  should  yield  an  empir- 
ically derived,  nonoverlapping  set  of  criteria  on 
which  to  evaluate  pilot  effectiveness.  For  this 
reason,  careful  attention  should  be  paid  to  the 
ACEVAL-AIMVAL  results  as  both  a testbed  to  evaluate 
other  approaches  to  the  measurement  of  pilot  cap- 
ability and  as  a source  of  validated,  objective 
measures  of  pilot  performance. 

6.3  SUMMARY  AND  COMMENTS 

This  review  of  air-to-air  combat  simulators 
reveals  that  they  have  broad  capabilities  and 
applications.  They  have  been  used  primarily  for 
training  and  as  design  tools.  As  such,  the  avail- 
able data  cannot  readily  be  manipulated  to  yield 
the  human  performance  reliability  measures  which 
are  needed  for  assessing  differences  in  pilot  capa- 
bility. Despite  this,  we  have,  for  a limited  set 
of  simulations,  extracted  data  suggesting  the  poten- 
tial utility  of  these  devices  in  the  selection 
domain.  Potential  human  performance  criterion  mea- 
sures including  theoretical  hits,  time  in  gun  (or 
missile)  envelope,  and  probabilitjj  of  a kill  have 
been  identified.  Studies  designed  to  provide  per- 
formance reliability  data  are  needed  to  further 
substantiate  the  potential  of  the  various  criterion 
measures. 


Data  from  mock  combat  engagements  on  the 
highly  instrumented  combat  maneuvering  ranges  (both 
ACMR  and  ACMI)  reveal  that  these  devices  can  be 
used  for  intermediate  validation  of  pilot  selection 
devices.  The  ACEVAL-AIMVAL  program  demonstrates 
that  these  ranges  can  be  used  for  applications 
beyond  training.  As  with  the  simulators,  there  is 
a great  need  for  human  performance  reliability  data 
from  the  combat  maneuvering  ranges  which  would  be 
invaluable  for  refining  criterion  measurement  for 
selection  purposes. 


27in  response  to  the  question,  "What  lessons  did 
you  learn  during  your  first  combat  engagement?" 

Our  pilot  sample  stressed  constant  search  of  the 
sky  for  the  enemy.  Typical  responses  were  as 
follows; 

"He  who  sees  the  other  man  first  has  the  over- 
whelming advantage. " 

"Always  keep  looking  for  far-away  enemy  air- 
craft - see  them  first  with  eyeball  or  radar." 

"Look  around,  look  around,  look  around!" 

"The  one  you  don't  see  is  the  one  that  will  get 
you . " 

"Eye  sight  covering  360°." 
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PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


7.0  ASSESSMENT  OF  THE  COST  EFFECTIVENESS 
OF  VARIOUS  SELECTION  TEST  INSTRUMENTS  AND 
THE  RECOMMENDED  AIR  COMBAT  EFFECTIVENESS 
STUDY  (ACES)  PROGRAM 


Section  4 identified  the  characteristics  and 
critical  skills  making  up  our  profile  of  the  combat 
effective  pilot.  This  profile  will  be  reviewed  on 
an  item-by-item  basis  to  select  the  most  cost- 
effective  test  instrument  for  obtaining  measures  to 
be  used  as  selection  criteria.  The  breakdown  of 
preliminary  selection  characteristics  by  testing 
techniques  will  be  summarized  and  used  to  define  a 
recommended  air  combat  effectiveness  study  (ACES) 
program.  The  ACES  program  will  consist  of  two 
parts,  a peacetime  preliminary  validation,  and  a 
combat  contingency  validation  plan.  The  peacetime 
validation  plan  will  be  dependent  upon  a selection 
test  program  using,  as  an  intermediate  criterion, 
pilot  performance  on  the  air  combat  maneuvering 
ranges.  This  approach  makes  use  of  a peacetime 
combat  surrogate  which  has  a high  degree  of  accept- 
ance among  experienced  combat  pilots  (see  Section 
6.2).  The  use  of  the  air  combat  maneuvering  ranges 
allows  the  validation  and  refinement  of  the  selec- 
tion program  without  the  necessity  of  engaging  in 
a major  aerial  war.  The  results  would  yield  a 
comprehensive  and  cohesive  pilot  selection  battery 
which  could  readily  be  validated  during  a major 
aerial  conflict.  An  overview  of  the  process  which 
led  to  the  ACES  program  is  shown  in  Figure  7.0-1. 

The  combat  contingency  validation  plan  outlines 
the  procedures  for  validating  the  selection  tests 
against  the  ultimate  criterion,  performance  during 
combat.  To  take  maximum  advantage  of  this,  it  is 
necessary  to  have  prepared  a comprehensive  data 
gathering  plan.  We  fully  recognize  the  fact  that 
the  exigencies  of  combat  prohibit  many  of  the 
niceties  of  experimentation  which  might  be  desirable, 
but  history  has  demonstrated  that  adequate  data 
recording  can  be  accomplished  within  the  combat 
arena.  This  can  only  be  done,  however,  when  data 
specifications  and  conditions  have  been  carefully 
defined.  The  plan  must  be  waiting  in  a standby  mode 
for  the  occurrence  of  a major  aerial  conflict. 


7 . 1  ASSESSMENT  OF  THE  COST  EFFECTIVENESS  OF  VARIOUS 
SELECTION  TEST  INSTRUMENTS 

In  Section  4,  12  major  pilot  selection  domains 
were  reviewed  and  factors  within  each  domain  were 
evaluated  for  inclusion  in  our  preliminary  profile 
of  the  combat  effective  pilot.  This  section 
reviews  the  recommended  selection  factors  within  the 
12  domains  and  evaluates  the  appropriateness  of  a 
number  of  test  instruments  for  use  in  assessing 
these  factors.  This  evaluation  was  based  upon  four 
criteria:  (1)  cost  of  application;  (2)  ease  of 

administration  and  impact  on  the  present  selection 
program;  (3)  objectiveness  of  scores;  and,  when 
available,  (4)  historical  validity  of  such  test 
instruments  as  a means  of  measuring  that  particular 
selection  factor.  Cost  of  application  includes  the 
cost  of  test  development  and  setup  and  the  cost  of 
administering  the  tests  to  the  candidates.  Ease  of 
administration  and  impact  of  the  tests  on  the  exist- 
ing programs  are  functions  of  the  number  of  students 
which  can  be  run  at  a given  time,  the  total  amount 
of  student  and  instructor  time  required  to  adminis- 
ter and  score  the  tests,  and  whether  or  not  the  use 
of  any  type  of  remote  facility  is  necessary  to  imple- 
ment the  tests.  Objectiveness  of  scores  is  related 
to  whether  the  scoring  procedure  on  the  test 
is  totally  objective  or  requires  some  subjective 
estimates  of  the  candidates'  capabilities.  Histor- 
ical validity  refers  to  the  degree  of  relationship 
between  predictors,  as  measured  by  various  test 
devices  (techniques),  and  criteria  of  combat  effec- 
tiveness reported  in  prior  research.  The  first  two 
criteria  (cost,  and  ease  of  administration  and 
impact)  tended  to  drive  our  decision  toward  the  sim- 
plest test  available  for  assessing  that  factor; 
whereas  the  last  two  criteria,  objectiveness  of 
scores  and  historical  validity,  tended  to  drive  our 
decision  toward  the  best  test  available,  regardless 
of  cost,  ease  of  administration,  or  impact. 

7.1.1  General  Discussion  of  Selection  Tools  - 
Their  Strengths  and  Weaknesses  - We  have  identified 
seven  test  methodologies  as  means  of  assessing  the 
characteristics  and  critical  skills  outlined  in  Sec- 
tion 4.  These  are  paper-and-penci 1 tests,  structured 
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interviews,  peer  and  instructor  ratings,  situational 
tests,  small  apparatus  tests,  large  facility  tests, 
and  job  sample  tests.  Each  of  these  test  methodol- 
ogies is  discussed  below. 

7. 1.1.1  Paper-and-Pencil  Tests  - Paper-and- 
pencil  tests  can  be  administered  as  group  tests, 
and,  depending  upon  the  questions  asked,  can  yield 
either  subjective  or  objective  responses.  Objective 
responses  can  be  obtained  using  such  measures  as 
number  correct  and  category  of  response.  Subjective 
responses  such  as  estimates  of  a candidate's  capa- 
bilities and  present  attitudes  can  also  be  obtained. 

These  instruments  have  an  extremely  low  cost  once 
the  test  has  been  developed.  They  should  have  a 
very  minor  impact  on  existing  programs  as  they  can 
be  inserted  into  programs  at  the  expense  of  an  hour 
or  two  of  time  per  candidate.  Since  this  time  would 
be  spent  in  a group  activity,  the  cost  of  the 
instructor  time  would  also  be  minimal.  Specific 
paper-and-pencil  test  items  would  have  to  be  gene- 
rated for  each  selection  factor  tested.  Once  this 
is  accomplished,  additional  costs  for  this  type  of 
test  are  extremely  low. 

7. 1.1. 2 Interviews  - In  general,  interviews 
tend  to  sample  some  of  the  same  types  of  character- 
istics measured  by  paper-and-pencil  tests.  They  are 
dependent  upon  a one-to-one  relationship  between  the 
candidate  and  the  interviewer.  A standardized 
interview  form  is  preferred  since  it  gives  str"cture 
to  the  interview  and  insures  that  all  of  the  rele- 
vant questions  are  asked.  The  measures  obtained  are 
primarily  subjective  since  they  relate  to  the  inter- 
viewer's impressions  of  the  candidate's  responses. 

Tape  recordings  of  the  interviews  can  be  obtained 
for  a more  objective  analysis,  but,  since  they  occur 
in  real  time, the  analysis  of  these  records  is  very 
time-consuming  and  costly.  The  objectivity  of  the 
interviewee's  responses  is  to  a great  extent  depen- 
dent upon  the  interviewer's  training  and  skills. 

Between- interviewer  reliability  can  be  moderately 
high  providing  the  interviewers  are  properly  trained. 
Because  of  the  nature  of  the  interview  situation, 
the  cost  per  candidate  for  this  technique  would  be 
quite  high.  The  impact  on  the  existing  program  can 
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be  minimized  by  inserting  candidate  interviews  into 
the  program  on  an  individual-by-individual  basis 
over  a period  of  time.  Due  to  the  basically  subjec- 
tive nature  of  the  interview  and  the  fact  that,  in 
our  opinion,  it  does  not  add  a significant  amount 
of  unique  data  unobtainable  by  paper-and-pencil 
tests  or  other  means,  we  feel  that  the  interview  is 
not  appropriate  for  inclusion  in  the  selection 
battery. 

7. 1.1. 3 Ratings  - There  are  two  types  of 
ratings  under  consideration:  ratings  by  the  candi- 

date's fellows  on  traits  or  capabilities  (peer 
ratings);  and  ratings  by  specially  trained  pilot 
instructors  on  traits  or  the  candidate's  competence 
in  performance  of  tasks  assigned  during  instruction 
(instructor  ratings).  One  of  the  major  drawbacks 
of  ratings  is  that  they  are  essentially  subjective 
in  nature.  Each  individual  is  rated  by  another  on 
the  basis  of  a number  of  undefined  variables.  Thus, 
it  is  possible  that  a candidate  can  be  given  a high 
rating  as  a function  of  his  popularity  rather  than 
his  capability.  Despite  this  subjectivity,  peer 
ratings  have  exhibited  rather  high  correlations 
with  combat  effectiveness.  Both  peer  ratings  and 
ratings  by  instructors  and  trained  observers  have 
been  used  successfully  by  the  Israelis.  Addition- 
ally, the  cost  per  candidate  for  instituting  these  1 

kinds  of  ratings  would  be  relatively  low,  approxi- 
mately the  same  as  the  cost  of  inserting  paper-and-  , 

pencil  tests  into  the  curriculum.  Each  student 
would  be  called  upon  to  rate  his  peers  on  a number 
of  selection  factors  which  have  been  identified. 

Pilot  instructor  ratings  would  be  obtained  in  much 
the  same  way  with  the  addition  of  ratings  on  compe- 
tence in  various  pilot  functions  as  well  as  personal 
characteristics.  Therefore,  in  view  of  the  rela- 
tively low  cost  and  the  empirical  validity  of 
ratings,  they  are  recommended  for  inclusion  in  the 
selection  battery. 

7. 1.1. A Situational  Tests  - Situational  tests 
assess  behavior  by  using  controlled  environments 
which  parallel  those  which  would  be  encountered  on 
the  job.  They  have  many  of  the  characteristics  of 
a job  sample  (e.g.,  stress),  but  they  are  designed 
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to  evaluate  emotional,  social,  attitudinal  and  other 
personality  variables.  The  Air  Force  currently  has 
a number  of  programs  which  could  be  considered 
situational  tests  should  the  measurements  and 
observational  criteria  be  applied  to  behaviors 
generated  in  and  by  the  situations.  Specifically, 
these  are  the  escape  and  evasion  school  and  the 
survival  school,  both  of  which  are  requirements 
for  Air  Force  pilots.  These  programs  are  meant  to 
be  training  environments  with  the  candidate  pilot 
learning  skills  necessary  for  survival  and  evasion 
of  would-be  captors,  and  successful  maintenance  of 
the  military  codes  should  he  be  taken  prisoner. 

The  Israelis  currently  use  a situational  testing 
environment  where  candidates  are  gathered  for  a 
rigorous  program  of  selection  testing  prior  to 
their  full  acceptance  into  the  pilot  program. 

While  this  type  of  test  is  quite  expensive  to  set 
up,  the  overall  cost  may  not  be  prohibitive  on  a 
cost  per  student  basis  because  it  is  essentially 
a group  testing  procedure.  In  addition,  unlike 
paper-and-pencil  tests,  situational  tests  would 
not  have  to  be  generated  for  each  selection  factor 
specified  in  our  selection  profile,  since  a given 
situational  test  could  provide  information  on  a 
number  of  these  factors.  This  type  of  test  has  the 
advantage  of  allowing  the  observer  and  the  peer 
group  to  assess,  in  a stressful  environment,  many 
personality  factors  which  might  be  sampled  by 
paper-and  pencil  tests  under  more  relaxed  condi- 
tions. The  real  combat  setting  is,  of  course,  very 
stressful,  and  the  more  the  testing  conditions 
approximate  that  contat  reality,  the  more  valid  the 
measures  obtained  will  be.  Implementation  of  sit- 
uational testing  would  have  a fairly  high  impact  on 
existing  programs.  The  normal  sequential  order  of 
training  would  have  to  be  broken  and  a survival 
school-like  procedure  would  have  to  be  instituted 
while  the  candidates  are  still  competing  for  the 
available  slots  in  the  pilot  training  program. 
Despite  this,  their  value  for  assessing  selection 
factors  which  cannot  be  measured  by  other  types  of 
tests  justifies  the  inclusion  of  situational  tests 
in  the  selection  program. 


7. 1.1. 5 Small  Apparatus  Tests  - Small  appar- 
atus tests  refer  to  those  tests  which  are  dependent 
upon  a relatively  simple  piece  of  equipment.  These 
tests  can  be  operated  by  a single  instructor  and 
should  be  highly  reliable  and  relatively  inexpensive. 
In  some  cases,  a single  test  can  be  used  to  measure 
more  than  one  ability,  but  the  test  itself  should 

be  chosen  and  developed  with  a specific  selection 
factor  in  mind.  These  apparatus  tests  can  range 
from  something  as  simple  as  a choice  reaction  device 
to  something  as  complex  as  a dynamic  peripheral 
vision  test.  The  latter  device  would  test  the  can- 
didate's capability  to  detect  moving  targets  in  the 
visual  periphery  while  concentrating  on  a difficult 
primary  task. 

These  tests  can  be  administered  on  a group 
basis  and  yield  objective  performance  measures. 

Once  the  basic  apparatus  is  in  place,  the  cost  per 
student  is  fairly  low.  The  impact  on  the  existing 
program  in  terms  of  time  cost  would  be  relatively 
low,  i.e.,  less  than  1/2  hour  per  student  per  test. 

It  is  possible  that  a group  of  these  tests  could 
be  given  in  sequence  in  a one  or  two  day  period 
within  some  type  of  specially  constructed  testing 
facility.  The  small  apparatus  test  represents  a 
very  effective  way  of  assessing  a number  of  percep- 
tual , motor,  and  judgmental  selection  factors. 

7. 1.1. 6 Major  Facility  Tests  - These  tests  are 
essentially  an  extension  of  the  small  apparatus 
tests,  but  they  are  generally  far  more  expensive, 
often  requiring  substantial  facilities  and  large 
staffs,  including  technicians  to  maintain  them  and 
other  auxiliary  personnel  for  instructional  and 
safety  reasons.  Two  examples  of  large  facility 
tests  would  be  the  centrifuge  and  the  altitude  test 
chamber.  These  test  apparatuses  essentially  dupli- 
cate severe  environments  in  which  the  pilot  must 
perform  during  combat.  They  offer  a unique  oppor- 
tunity to  evaluate  performance  under  environmental 
stress.  Such  large  facility  tfests  are  expensive  to 
operate  and  generally  are  remotely  located  from 
major  pilot  selection  and  training  centers.  The 
utilization  of  such  tests  would  obviously  have  a 
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significant  impact  on  existing  programs,  requiring 
large  amounts  of  time  and  money  to  maintain  them  as 
well  as  taking  up  a significant  amount  of  time  per 
candidate.  On  the  positive  side,  they  are  capable 
of  producing  objective  performance  measures  of 
students'  reactions  to  psychological  and/or  physio- 
logical stress.  The  capability  to  withstand  this 
type  of  stress  is  an  attribute  which  pilots  have 
rated  as  very  important  for  becoming  an  effective 
combat  aviator.  Because  of  the  cost  involved  with 
the  major  facility  tests,  they  are  not  recommended 
for  use  at  the  candidate  level.  However,  they  do 
offer  an  opportunity  for  significant  refinement  in 
the  selection  procedures  should  they  be  applied  as 
part  of  a secondary  selection  program  for  pilot 
training  graduates  or  undergraduates. 

7. 1.1. 7 Job  Sample  Tests  - Job  sample  tests 
require  performance  of  components  of  the  piloting 
task.  Excellent  job  sample  situations  for  select- 
ing fighter  pilots  would  be  major  air  combat  maneu- 
vering simulators  such  as  the  one  at  NASA,  Langley 
or  McDonnell  Douglas,  St.  Louis.  In  these  facili- 
ties, pilots  are  able  to  fly  simulated  combat 
engagements  against  each  other  in  a reaiistic 
environment.  These  facilities  have  been  extensively 
discussed  in  Section  6.1.  For  specific  elements  of 
the  air  combat  procedure,  other  job  sample  tests  or 
facilities  can  be  constructed.  It  is  possible  that 
a relatively  small  and  economical  air  combat  maneu- 
vering job  sample  device  could  be  designed  which 
would  allow  pilots  to  engage  in  air  combat  tasks 
within  a limited  budget  program.  The  data  we  have 
generated  to  date  indicate  that  the  major  simulators 
have  proven  to  not  only  discriminate  between  pilots 
along  a dimension  of  air  combat  capability,  but 
function  as  useful  training  devices. 

Measures  on  the  job  sample  type  tests  can  be 
objective  or  subjective.  Objective  measures  of 
kills,  time  in  gun  envelope,  and  mean  performance 
measures,  such  as  the  AML  used  by  NASA,  Langley, 
can  be  generated  directly  from  the  central  computer 
controlling  the  simulator.  Subjective  estimates  of 
how  well  the  mission  was  actually  flown  are  typical- 
ly obtained  from  instructor  pilots  reviewing  mission 
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tapes  during  the  debriefing  sessions.  Cost  per 
student  would  be  fairly  high  and  the  tests  would 
probably  have  to  come  sometime  after  admission  into 
the  first  phase  of  pilot  training.  Both  of  these 
factors  would  have  significant  impact  on  the  exist- 
ing programs.  However,  current  Air  Force  policy 
appears  to  include  the  utilization  of  fairly  com- 
plex simulators  for  undergraduate  pilot  training. 

We  specifically  refer  to  the  Simulator  for  Air-to- 
Air  Combat  located  at  Luke  Air  Force  Base  which  was 
discussed  in  Section  6.1.  This  device  has  the 
capability  to  be  used  as  a selection  tool  and  would 
have  less  of  an  impact  on  an  existing  program  of 
pilot  training  than  constructing  some  specialized 
large  job  sample  facility  elsewhere.  Overall,  the 
job  sample  approach  has  many  similarities  to  the 
situational  testing  approach.  Both  provide  informa- 
tion about  general  performance  level.  Job  sample 
tests  measure  skill  level,  whereas  the  situational 
tests  assess  willingness  to  perform.  The  job  sample 
approach  represents  one  of  the  most  integrated  tasks, 
yielding  information  on  a number  of  specific  apti- 
tide  skill  factors  as  well  as  having  implications 
for  personal  characteristics  such  as  aggressiveness, 
risk  taking,  and  determination.  It  provides  a high 
degree  of  realism  when  considering  the  actual  task 
of  air  combat. 
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7.1.2  An  Assessment  of  the  Cost  Effectiveness 
of  Seven  Types  of  Selection  Instruments  for  Testing 
Each  of  the  Factors  within  the  Twelve  Selection 
Domains  - The  seven  selection  test  instruments 
described  in  Section  7.1.1  were  evaluated  as  method- 
ologies for  assessing  each  of  the  selection  factors 
within  the  12  domains,  and  the  most  cost  effective 
method  for  testing  each  selection  factor  was  identi- 
fied. The  results  of  this  analysis  are  shown  in 
Figure  7.1-1.*  This  figure  integrates  the  recommen- 
dations concerning  which  selection  factors  should  be 
investigated  further  (see  Section  4),  with  recommen- 
dations regarding  the  best  testing  methodology  for 
each  factor. 


'This  list  is  meant  to  be  as  exhaustive  as  possi- 
ble, and  many  of  the  selection  factors  probably  over- 
lap with  other  factors.  The  final  selection  battery 
will  be  refined  in  an  attempt  to  define  a set  of 
more  distinctive  factors. 
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PERFORMANCE  UNDER  STRESS 

X 

X 

EMOTIONAL  CONTROL 

X 

X 

ABILITY  TO  RITHSTAND  PSYCHOLOGICAL  STRESS 

X 

X 

ANXIETY  TOLERANCE 

X 

X 

RISK  TAKING 

f ILLINGNESS  TO  TAKE  CALCUUTEO  RISKS 

X 

X 

SOCIAL  FACTORS 

TEAMVORK 

X 

X 

SOCIABILITY 

X 

X 

GROUP  LOYALTY 

INTERPERSONAL  RATING 

X 

X 

BIOGRAPHICAL  DATA 

LIFE  INVENTORY 

X 

X 

ACADEMIC  HISTORY 

X 

MILITARY  HISTORY 

MILITARY  RANK 

la 

FIGURE  7.1-1  ANALYSIS  OF  CHARACTERISTICS  AND  CRITICAL  SKILLS  FOR  THE 
PREDICTION  OF  THE  COMBAT  EFFECTIVE  FIGHTER  PILOT 

MTC:  SHADCO  BOX  MnUTES  THIS  FXCTOB  IS  WXPrmPBIXTE  FOR  TESTIRG 
XT  THE  CARDIOXTE  FOR  PILOT  TRXIRIRC  LEVEL. 


The  analysis  Indicated  that  two  of  the  selec- 
tion methodologies,  interviews  and  major  facility 
tests,  were  not  cost  effective  for  any  of  the 
selection  factors  identified.  They  were,  therefore, 
dropped  from  the  analysis.  The  figure  also  lists  a 
number  of  selection  factors  which  were  not  recom- 
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mended  for  testing.  In  addition  to  these  factors, 
four  factors  were  revealed  as  being  inappropriate 
for  testing  the  candidate  at  the  entry  level  of 
pilot  training.  Of  these  four,  flight  skills  and 
quality  of  combat  decisions  can  best  be  tested  at 
the  end  of  pilot  training  or  advanced  training  by 
using  simulators  or  the  ACMR/I.  The  other  two 
factors  in  this  category,  military  rank  and  history, 
are  already  adequately  recorded  by  existing  Air 
Force  procedures.  These  four  factors  were,  there- 
fore, omitted  from  our  preliminary  profile. 

A review  of  the  remaining  selection  factors 
shown  in  Figure  7.1-1  yielded  three  major  testing 
categories:  those  factors  which  can  be  most  effec- 

tively tested  by  paper-and-penci 1 tests,  small 
apparatus  and  job  sample  tests,  or  situational 
tests  and  ratings.  Small  apparatus  and  job  sample 
tests  are  recommended  for  testing  those  factors 
relating  to  the  candidate's  physical  capabilities 
with  respect  to  combat  flying.  Situational  tests 
and  ratings  are  suggested  for  evaluating  the  candi- 
date's personal  characteristics  to  determine  whether 
or  not  he  possesses  the  personality  and  motivational 
factors  normally  captured  in  the  phrase,  "will  to 
fight."  Recommendations  for  paper-and-penci 1 tests 
are  distributed  among  both  aptitude  and  personal 
characteristics.  Section  7.2  reviews  the  selection 
factors  listed  under  each  of  these  testing  cate- 
gories and  lists  tests  representative  of  those  which 
could  be  used  in  the  final  program. 

7.1.3  Cost  Factors  for  the  ACES  Program  - The 
analysis  in  Section  7.1.2  identified  the  types 
of  tests  which  would  provide  the  most  cost  effec- 
tive testing  program.  Further  delineation  of  the 
program  is  dependent  upon  budgetary  considerations 
and  the  priority  for  the  development  and  validation 
of  the  ACES  program  given  by  the  military.  The 
various  testing  procedures  identified  have  signifi- 
cantly different  developmental  costs  ranging  from 
inexpensive,  off-the-shelf  paper-and-penci 1 tests, 
to  special  job  sample  simulators  costing  ten  mil- 
lion dollars  or  more. 
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Analysis  of  these  costs  by  testing  categories 
indicates  that  different  testing  methodologies  have 
different  cost  distributions  over  their  various 
developmental  and  implementation  phases.  Costs 
associated  with  paper-and-pencil  tests  are  most 
highly  concentrated  in  the  developmental  phases. 

An  example  of  the  cost  breakdown  for  this  type  of 
test  is  found  in  Appendix  7. A.  The  values  given 
were  generated  for  the  Pilot  Life  Inventory  Ques- 
tionnaire (Short  Form)  developed  for  use  as  a 
pilot  selection  instrument.  The  cost  of  development 
for  this  type  of  test,  including  a preliminary  vali- 
dation, is  approximately  one  hundred  thousand  dollars. 
After  this  initial  cost,  additional  administration 
and  scoring  costs  should  be  relatively  small.  (The 
best  estimate  of  the  cost  of  administration  of 
these  tests  within  the  Air  Force  would  come  from 
existing  costs  records  regarding  the  AFOQT.) 

Small  apparatus  and  job  sample  tests  are  gen- 
erally more  expensive  than  paper-and-pencil  tests 
with  a much  wider  range  of  potential  costs.  Simple, 
small  apparatus  tests  for  a number  of  prediction 
factors  are  already  in  development  by  Dr.  Richard 
Pew  under  contract  to  the  Air  Force  Human  Resources 
Laboratory  (Pew  and  Adams,  1975).  These  test  appar- 
atuses should  be  relatively  inexpensive  to  construct 
costing  between  one  and  five  thousand  dollars  per 
testing  unit.  Additional  costs  for  data  reduction 
hardware  and  software  would  increase  the  facility 
cost  by  several  thousand  dollars,  however,  the  same 
control  facility  could  be  used  for  a number  of  small 
apparatus  tests.  This  cost-saving  consolidated 
facility  concept  could  only  be  utilized,  however, 
if  a central  testing  facility  were  developed. 

Job  sample  tests  are  significantly  more  expen- 
sive than  small  apparatus  tests.  They  can  range 
from  three  hundred  and  fifty  thousand  dollars  for 
a specifically  programmed  General  Aviation  Trainer 
to  over  ten  million  dollars  for  an  interactive  air- 
to-air  combat  simulator.  A cost  analysis  for  a 
selection  test  device  which  would  present  the 
critical  tasks  of  aerial  gunnery  is  given  in 
Appendix  7. A.  This  device  would  cost  about  one 
million  six  hundred  and  twenty-five  thousand 
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dollars  for  the  initial  unit  and  seven  hundred  and 
eighty-five  thousand  dollars  for  subsequent  units. 
However,  this  single  device  would  incorporate  a 
large  number  of  perceptual  and  perceptual-motor 
tasks  which  could  be  tested  either  separately  or  on 
an  interactive  basis,  thus  providing  some  savings 
on  single  function  tests  and  allowing  estimates  of 
interactive  processes.  Another  potential  job  sample 
test  makes  use  of  the  General  Aviation  Trainer. 

This  device  has  shown  considerable  promise  as  a 
selection  instrument  when  validated  against  success 
in  training  (Long  and  Varney,  1975)  and  should  be 
investigated  for  use  in  the  ACES  program.  The  cost 
of  this  device  is  about  eighty-five  thousand  dollars 
for  the  basic  simulator  hardware  and  another 
two  hundred  sixty-five  thousand  dollars  for  periph- 
eral equipment  and  software.  Once  again,  a common 
central  computer  would  significantly  reduce  test 
costs.  Costing  specifics  of  this  system  can  also 
be  found  in  Appendix  7. A. 

Situational  tests  and  ratings  have  relatively 
low  set  up  costs;  however,  cost  of  administration 
on  a per  candidate  basis,  is  substantial.  The 
actual  costs  will  be  test  specific  and  will  depend 
on  the  nurriber  of  candidates  being  tested,  the  com- 
plexity of  the  test  structure,  and  the  number  of 
professionals  necessary  for  proper  administration 
of  the  test.  To  be  carried  out  effectively,  a 
central  testing  station  is  again  recommended. 

The  development  of  a comprehensive  test  battery 
will  require  the  integrated  efforts  of  a number  of 
content  area  experts.  To  expedite  the  program  and 
take  advantage  of  existing  test  development  capa- 
bilities present  in  the  military,  industry,  and  the 
academic  community,  a central  agency  should  be 
identified  to  integrate  and  coordinate  elements  of 
the  testing  program  which  are  undertaken  by  specific 
content  experts.  This  approach  would  allow  for  the 
inputs  of  acknowledged  experts  in  specific  topic 
areas.  A strong  central  coordinating  function 
should  also  be  present  to  maintain  a proper  balance 
and  control  of  the  program.  The  ACES  program  must 
have  a sufficient  budget  for  the  development, 
administration,  and  validation  of  the  selection 
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test  battery.  This  can  only  be  achieved  through  a 
strong  long-term  commitment  from  the  military  com- 
munity, to  insure  the  support  necessary  for  the 
multi-year  effort  required  if  the  program  is  to  be 
successful . 
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7 . 2 SUGGESTED  APPROACHES  TO  TESTING  FACTORS  RECOH- 
HENDED  FOR  INCLUSION  IN  THEAIR  COMBAT  EFFECTIVE- 
NESS STUDY  (ACES)  PROGRAM 

The  cost  effectiveness  analysis  in  Section  7.1 
revealed  three  clusters  of  factors.  These  consist 
of  factors  which  can  be  most  efficiently  tested 
with  paper-and-pencil  tests,  small  apparatus  and 
job  sample  tests,  and  situational  tests  and  ratings 
(see  Figure  7.2-1).  In  this  section,  more  specific 
initial  approaches  to  testing  the  factors  within 
each  of  the  thpee  clusters  will  be  suggested. 


ACES  SELECTION  TEST  PROGRAM 
PAPER  AND  PENCIL  I SMALL  APPARATUS 
SELECTION  TESTS  AND  COMBAT  JOB 
SAMPLE  TESTS 


, PILOT  COMPOSITES 
. EQUIPMENT 
KNOWLEDGE 


. ABILITY  TO  WITHSTAND 
PHYSIOLOGICAL  STRESS 
. FLIGHT  APTITUDE 


> PERSONALITY  STYLE  (GENERAL  AND  COMBAT) 


, SATISFACTION 
, LIFE  INVENTORY 


. SELECTIVE  ATTENTION 
. DECISION  TIME 
. ALERTNESS 
. INTEGRATIVE  DECISIONS 
. VISUAL  PERCEPTION 
. MOTOR  COORDINATION 
. SPATIAL  ORIENTATION 
. SPATIAL  PERCEPTUAL 
ABILITY 

. PERCEPTUAL  SPEED 
. INSTRUMENT  READING 
. AERIAL  GUNNERY 


SITUATIONAL 
TESTS  AND 
RATINGS  (BY 
PEERS  AND 
OTHERS) 

. AGGRESSIVENESS 

• SELF  CONFIDENCE 
. COURAGE 

• RESPOKSIBILin 
FOR  MEN  IN  COMBAT 

. PHYSICAL  ANO 
COMBAT  LEADER- 
SHIP 

. DETERMINATION  ' 
DESIRE 

. SELF  DISCIPLINE 
, PERFORMANCE 
UNDER  STRESS 
. EMOTIONAL 
CONTROL 

• ABILITY  TO  WITH- 
STAND PSYCHOLOGI- 
CAL STRESS 

. ANXIETY  TOLERANCP 
. WILLINGNESS  TO  TAK.i 
CALCUUTED  RISKS 
. TEAMWORK 
. SOCIABILITY 
. INTERPERSONAL 
RATING 


FIGURE  7.2-1  SELECTION  FACTORS  AND  TESTING 
METHODOLOGIES 


7.2.1  Factors  to  be  Tested  by  Paper-and-Pencil 
Tests  - Numerous  paper-and-pencil  tests  which  have 
been  used  for  the  selection  of  other  military  person- 
nel and  pilots,  in  general,  could  easily  be  adapted 
for  the  selection  of  combat  effective  fighter  pilots. 
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Furthermore,  many  paper-and-pencil  tests  which  are 
available  for  other  purposes  can  be  adapted,  or 
used  in  their  present  form  for  that  purpose.  These 
include  both  pilot  composites  and  tests  of  person- 
ality style  (see  Figure  7.2-1).  A good  starting 
point  for  developing  pilot  composites  is  with  the 
revision  of  the  components  of  the  AFOQT.  "Person- 
ality style"  and  "satisfaction"  can  probably  be 
assessed  with  a variety  of  existing  personality 
testing  devices. 

The  assessment  of  personality  factors  using 
paper-and-pencil  tests  has  a long  history  (DuBois, 
1970),  and  many  devices  are  undoubtedly  appropriate 
candidates  for  inclusion  in  our  recommended  fighter 
pilot  selection  program.  They  would,  of  course, 
have  to  be  validated  against  performance  in  the 
operational  environment.  Egbert,  Meeland,  Cline, 
Forgy,  Spickler,  and  Brown  (1957)  used  the  Minnesota 
Multiphasic  Personality  Inventory  (MMPI),  the 
California  Psychological  Inventory  (CPI),  and 
Cattell's  Sixteen  Personality  Factor  Test  as  part 
of  their  test  battery  and  found  these  devices  use- 
ful for  distinguishing  between  fighters  and  non- 
fighters. It  is  not  unreasonable  to  expect  that 
these  devices  would  also  be  useful  for  selecting 
combat  effective  fighter  pilots.  Other  paper-and- 
pencil  personality  tests  such  as  the  Eysenck 
Personality  Inventory  (EPI)  may  be  useful  for  dis- 
tinguishing among  pilots. 

Life  inventory  factors  can  best  be  assessed  by 
some  variant  of  our  own  Pilot  Life  Inventory  Ques- 
tionnaire which  has  been  developed  expressly  for 
the  purpose  of  selecting  combat  effective  fighter 
pi  lots  (see  Section  5) . 

Equipment  knowledge  tests  could  be  developed 
from  tests  of  pilot  skills,  knowledges,  and  tasks 
which  have  been  investigated.  In  addition  to  the 
aviation  information  components  of  the  USAFOQT 
(AF  PT  974,  1 Sep  73)  in  booklet  5,  the  special 
vocabulary  tests  which  were  used  by  the  World  War  II 


^For  a tabular  summary  of  paper-and-pencil  per- 
sonality tests,  see  Appendix  E of  Anastasi  (1976). 
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nesearchers  (Lepley,  1947)  and  by  Korean  War  research- 
ers (e.g.,  Torrance,  Rush,  Kohn,  and  Doughty,  1957) 
would  be  useful  sources  for  the  development  of  ade- 
quate tests  of  equipment  knowledge. 

7.2.2  Factors  to  be  Tested  by  Small  Apparatus 
and  Job  Sample  Tests  - Small  apparatus  tests  are 
suggested  for  assessing  factors  within  the  domains 
of  medical  variables  (ability  to  withstand  physio- 
logical stress),  decision  making/information  pro- 
cessing (selective  attention,  decision  time,  alert- 
ness), and  sensory-motor  abilities  (visual  percep- 
tion, motor  coordination,  spatial  orientation,  spa- 
tial-perceptual ability,  perceptual  speed)  (see 
Figure  7.2-1). 

Physiological  stress  tests  using  small  appar- 
atus can  be  used  for  assessing  the  ability  to  with- 
stand various  physiological  stresses  involving 
vestibular,  ergonomic,  cardiovascular,  and  thermal 
stressors.  Tests  of  these  types  have  been  used  for 
selecting  pilots  for  very  special  roles  such  as 
astronaut  training.  Significantly,  some  types  of 
physiological  stress  tests  appear  to  have  an  impor- 
tant psychological  component.  Anxiety  responses  to 
altitude  chamber  (a  large  apparatus  test)  experi- 
ences are  common  and  a potential  way  of  selecting 
out  poor  risk  pilot  candidates.  Surprisingly,  very 
simple  (although  painful)  thermal  stress  experiences 
appear  effective  in  discriminating  between  pilot 
candidates.  For  example,  a substantial  percentage 
of  the  more  than  thirty  candidates  bidding  for  the 
initial  seven  astronaut  slots  refused  or  would  not 
endure  a modest  test  (keeping  their  feet  in  icewater 
For  approximately  20  minutes)  of  cold  exposure. 

Some  information  processing  tests  use  small 
apparatus.  Several  of  these  tests  are  available 
for  use  in  selecting  pilots.  Recently,  Pew  and 
Adams  (1975)  have  identified  six  candidate  infor- 
mation processing  tasks  which  show  promise  for  pre- 
dicting success  in  flying  training.  Among  those 
tasks  are  "manageability  of  attention"  and  "multiple- 
task  management  and  workload  capacity." 


Manageability  of  attention  includes  two  areas 
we  have  identified  for  testing  fighter  pilots, 
selective  attention  and  alertness.  Developments 
in  the  study  of  attention  indicate  that  several 
reasonable  measures  are  available  for  assessing 
this  domain  (Broadbent,  1971;  Kahneman,  1973). 

These  range  from  measures  of  pupil  dilation  and 
direction  of  gaze  to  target  detection  in  a vigil- 
ance task.  Moderately  simple  apparatus  tests  exist 
for  obtaining  these  measures. 

Tests  of  decision  time  and  perceptual  speed 
were  investigated  as  tests  for  selecting  combat 
effective  pilots  and  found  to  be  reasonable  for 
that  purpose  (Lepley,  1947;  Torrance,  ^ a^,  1957). 

A reaction  to  signals  test  was  used  for  distinguish- 
ing fighters  from  non-fighters  (Egbert,  et.  al, 

1957).  Since  equipment  for  this  type  of  testing 
has  become  inexpensive  and  highly  rel iable, develop- 
ment of  this  class  of  test  should  be  straightfor- 
ward and  relatively  simple  when  compared  with  some 
other  tests. 

Visual  perception  is  a very  broad  domain,  but 
certain  types  of  tests  from  this  domain  such  as  hid- 
den figure  tests  (Jenkins,  Ewart,  and  Carroll,  1950) 
and  rod  and  frame  tests  (Pew  and  Adams,  1975)  seem 
to  hold  promise  for  use  in  fighter  pilot  selection. 
These  tests  will  provide  a starting  point  for  small 
apparatus  perceptual  test  development  in  our  pro- 
posed program. 

Small  apparatus  tests  of  the  sensory-motor 
variety  are  also  available  for  use  in  pilot  selec- 
tion. This  type  of  small  apparatus  test  is  recom- 
mended for  assessing  motor  coordination,  spatial 
orientation,  and  spatial-perceptual  ability.  During 
World  War  11,  apparatus  test  measures  were  relatively 
efficient  predictors  of  aviation  combat  performance. 
Tests  producing  the  highest  validity  coefficients 
were  the  Complex  Coordination,  Finger  Dexterity, 
and  Rotary  Pursuit  tests,  and  the  Army  Spatial 
Orientation  Test  (Lepley,  1947;  Torrance,  et 
1957).  Although  apparatus  tests  were  discontinued 
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Shortly  after  World  War  II  due  to  technical  and 
administrative  problems,  renewed  interest  in  their 
development  is  presently  being  expressed  (McGrevy 
and  Valentine,  1974;  Passey  and  McLaurin,  1966; 
Sanders,  Valentine,  and  McGrevy,  1971).  For  exam- 
ple, a Complex  Coordination  test  modeled  after  the 
one  used  during  World  War  II  has  been  developed 
(McGrevy  and  Valentine,  1974;  Sanders,  et  a^,  1971). 
Therefore,  our  present  level  of  technology  permits 
the  use  of  apparatus  tests  for  assessing  these 
sensory-motor  factors. 

The  job  sample  approach  attempts  to  reproduce 
a segment  of  the  actual  job  and  to  predict  future 
performance  on  the  basis  of  performance  on  that  job 
segment.  Job  sample  tests  have  many  similarities  to 
small  apparatus  tests  although  they  tend  to  be  more 
complex  and  expensive.  Whereas  the  small  apparatus 
test  attempts  to  measure  the  capabilities  underly- 
ing effective  job  performance,  the  job  sample  takes 
a more  straightforward  approach  and  yields  direct 
measures  of  job  performance.  Six  of  the  selection 
factors  were  recommended  for  testing  by  job  sample 
techniques.  Two  of  these  were  considered  inappro- 
priate for  testing  at  the  candidate  entry  level  (see 
Figure  7.1-1).  These  factors,  flight  skills  and 
quality  of  combat  decisions,  would  require  an  exten- 
sive job  sample  on  the  level  of  an  interactive  air 
combat  simulation.  Flight  aptitude  and  integration 
decisions  could  be  tested  using  a job  sample  in  a 
ground  trainer  (Air' Force  System  Command,  1971). 

Long  and  Varney  (1975)  had  significant  success  in 
predicting  completion  of  UPT  using  a General  Avia- 
tion Trainer  and  a five  hour  learning  sample  of 
flight  tasks. 

Instrument  reading  can  be  tested  through  the 
use  of  relatively  low  fidelity  job  sample  simulators. 
Evidence  from  transfer  of  training  studies  (Prophet 
and  Boyd,  1970)  indicated  equivalent  training  using 
complex  high  fidelity  simulators  and  low-fidelity 
mockups. 

Job  sample  devices  for  aerial  gunnery  have 
been  analyzed  to  define  the  minimum  requirements  of 
an  effective  simulator  for  training  (Ross  and  Whalen, 
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1976).  This  study  indicated  that  perceptual 
factors  as  well  as  hand/eye  coordination  were 
important  for  successful  aerial  gunnery.  The  inte- 
gration of  both  of  these  factors  would  require  a 
fairly  extensive  simulation  facility  rather  than  a 
simple  hand/eye  coordination  track  and  shoot  system 
which  could  be  handled  by  a small  apparatus  test.  I 

I 

j 

7.2.3  Factors  to  be  Tested  by  Situational  ; 

Tests  and  Ratings  - Situational  tests  are  struc-  | 

tured  environments  which  simulate  those  which  are 
expected  to  occur  in  real  life  (Anastasi,  1976; 

Fiske,  1954;  OSS  Assessment  Staff,  1948;  Weislogel, 

1954).  These  types  of  tests  differ  from  work  sam- 
ples in  that  the  behaviors  assessed  are  more  global 
and  complex,  e.g.,  motivation,  leadership.  Although 
Situational  tests  are  among  the  more  expensive 
testing  devices,  they  provide  an  avenue  for  assess- 
ing factors  which,  to  date,  have  presented  challeng- 
ing measurement  problems. 

Typically,  behaviors  in  situational  tests  are  - 

assessed  through  objective  measures  of  performance 
or  through  ratings  by  trained  observers  (Anastasi, 

1976).  We  suggest  that  peer  ratings  be  added  as  an 
additional  assessment  technique.  Several  studies 
report  relatively  high  correlations  between  peer  ll 

ratings  and  nonaviation  combat  performance  (Katter 

V ’ 

and  Holmon,  1954;  Katz,  Burke,  and  King,  1955;  King, 
Campbell,  Johnson,  Klieger,  and  Yaukey,  1952; 

Pulliam  and  Mathers,  1976).  However,  these  peer 
ratings  are  obtained  after  a lengthy  period  of  I 

interaction  between  military  candidates.  Situa-  ] 

tional  tests  provide  a means  of  obtaining  peer  j 

ratings  within  a shorter  period  of  time  to  allow 
for  the  early  selection  of  fighter  pilots. 

We  recommend  situational  tests  for  assessing 
the  factors  listed  in  the  last  column  of  Figure 
7.2-1.  These  factors  fall  within  the  domains  of 
personality-leadership  (responsibility  for  men  in 
combat,  physical  and  combat  leadership),  social 
variables  (teanwork,  sociability),  reaction  to 
stress  (performance  under  stress,  emotional  control, 
ability  to  withstand  psychological  stress,  anxiety 
tolerance),  risk-taking  (willingness  to  take  a 
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calculated  risk),  motivation  (determination/desire, 
self-discipline),  and  personality  (aggressiveness, 
self-confidence,  courage). ^ 


One  of  the  most  impressive  applications  of 
situational  tests  is  the  Leaderless  Group  Discussion 
(Anastasi,  1976).  In  this  technique,  a group  is 
given  a topic  to  discuss  within  a predetermined 
period  of  time  and  the  behavior  of  each  individual 
is  rated  by  an  observer.  This,  and  other  types  of 
leaderless  group  situations  have  been  used  to 
assess  factors  such  as  cooperation,  teamwork,  and 
leadership.  The  reliability  of  the  Leaderless  Group 
Discussion  is  reported  to  be  relatively  high  and 
strong  relationships  have  been  found  between  ratings 
derived  from  this  situation  and  ratings  in  military 
settings  (Anastasi,  1976).  Therefore,  this  type  of 
situational  test  is  recommended  for  testing  person- 
ality-leadership (responsibility  for  men  in  combat 
physical  and  combat  leadership)  and  social  (team- 
work, sociability)  factors. 


A second  category  of  situational  test  which 
has  been  devised  is  the  situational  stress  test. 
Validity  data  are  scarce,  and,  when  reported,  poor 
correlations  have  been  found  (Anastasi,  1976).  One 
possible  explanation  for  these  discouraging  find- 
ings is  that  these  tests  are  not  sufficiently 
stressful.  For  example,  one  stress  test  used  by 
the  Office  of  Strategic  Services  (OSS  Assessment 
Staff,  1948)  was  to  frustrate  military  candidates 
by  interfering  with  their  performance  during  a cube 
assembly  task.  Examples  of  more  stressful  situa- 
tional tests  which  may  be  employed  are  described 
by  Berkun,  Bialek,  Kern,  and  Vagi  (1962).  Behav- 
ioral and  physiological  responses  were  monitored 
during  five  stressful  situations.  Four  of  these 
were  life  threatening.  These  consisted  of  a simu- 
lated radioactive  fallout,  a simulated  forest  fire, 
a simulated  disruption  of  a military  exercise  by 
misdirected  artillery  shells,  and  a simulated  air- 
craft emergency.  The  latter  two  situations  pro- 
duced the  most  severe  stress  reactions.  Although 
the  validity  of  these  tests  was  not  addressed, 
these  data  suggest  that  these  types  of  situations 


may  prove  to  be  highly  sensitive  to  differences  in 
a number  of  factors.  Included  in  this  category  are 
factors  related  to  reaction  to  stress  (performance 
under  stress,  emo^^onai  '-.ontrol , ability  to  with- 
stand psychological  stress,  anxiety  tolerance), 
risk  taking  (willingness  to  take  a calculated  risk), 
motivation  (determination/desire,  self-discipline), 
and  personality  (aggressiveness,  self-confidence, 
courage). 


^In  accordance  with  the  code  of  ethics  of  the 
American  Psychological  Association  and  because  of 
our  concern  for  the  well-being  of  candidates  par- 
ticipating in  such  a testing  program,  extreme  care 
will  be  exercised  to  ensure  that  the  participants' 
dignity  and  welfare  are  respected.  Deception  of 
any  candidate  would  only  be  used  if  necessary  and 
then  only  after  proper  steps  have  been  taken  to 
ensure  that  the  procedures  would  not  be  likely  to 
cause  serious  and  lasting  harm  to  the  candidate. 
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7.3  ACES  AIR  COMBAT  MANEUVERING  RANGE  PERFORMANCE 
ASSESSMENT  PROGRAM 

The  next  step  in  the  ACES  program  is  to  develop 
a combat  effective  pilot  selection  test  battery  from 
the  profile  of  the  ace  fighter  pilot  described  in 
Section  4.  This  test  battery  should  be  integrated 
into  an  overall  selection  data  acquisition  plan 
which  keeps  records  of  a pilot's  progress  and  per- 
formance capabilities  throughout  his  training  career. 
While  prediction  to  success  in  training  is  important 
as  an  interim  step  on  the  way  to  developing  selection 
procedures  for  the  combat  effective  pilot,  it  should 
not  be  used  as  the  primary  criterion  for  placement 
in  fighter  cockpits.  Assignment  to  fighter  aircraft 
should  be  base(J  on  combat-related  criteria.  The 
development  of  appropriate  selection  procedures, 
therefore,  requires  a major  validation  program  based 
on  these  types  of  criteria.  This  validation  program 
would  identify  which  of  the  many  factors  included  in 
the  pilot  selection  test  battery  actually  predicted 
performance  in  air-to-air  combat.  Plans  for  combat 
validation  are  given  in  Section  7.4  and  must  wait 
until  an  aerial  conflict  of  major  proportion  occurs. 
As  an  intermediate  validation  step, we  propose  that 
an  air  combat  surrogate,  specifically  the  ACMR/I.be 
used  to  validate  the  pilot  selection  test  battery. 

The  ACHR/I  has  generally  received  very  strong  pilot 
endorsements  (see  Section  2 and  Section  6.2).  Vali- 
dation on  the  ACHR/I  would  enhance  our  selection 
capability  by  allowing  us  to  select  applicants  who 
not  only  have  the  necessary  skills  for  success  in 
training  but  also  possess  the  skills  and  perceptual 
capabilities  required  for  effective  air-to-air  com- 
bat. In  addition  to  improving  current  selection 
procedures,  data  from  the  validated  test  battery 
will  serve  as  a data  base  for  the  final  validation 
against  actual  combat  criteria. 

7.3.1  Implementation  of  the  ACES  Selection 
Test  Battery  - Once  the  selection  test  battery 
discussed  in  Section  7.2  is  developed,  a testing 
program  should  be  defined  which  would  allow  for 
the  assessment  of  pilot  candidates  in  a cost  effec- 
tive manner.  The  exact  nature  of  this  program  will 
be  a function  of  several  factors.  Among  these  are 
the  number  of  candidates  to  be  screened,  funding 


levels  available,  the  amount  of  change  which  will 
be  permitted,  and  the  feasibility  of  establishing  a 
separate  testing  facility.  Our  analysis  in  Sec- 
tions 7.1  and  7.2  indicated  that,  at  the  very  least, 
a testing  facility  for  the  housing  of  small  appar- 
atus tests  and  a testing  session  for  the  administra- 
tion of  situational  tests  would  be  required.  The 
final  structure  of  the  program  will  depend  upon  the 
definition  of  the  selection  test  battery  and  the 
degree  of  military  support  with  respect  to  the 
implementation  of  this  program. 

7.3.2  Peacetime  Validation  of  the  Pilot 
Selection  Test  Battery  on  the  ACMR/1  - The  next 
step  in  the  ACES  program,  after  the  implementation 
of  the  combat  effective  pilot  selection  test  bat- 
tery, is  the  peacetime  validation  phase.  The  use 
of  success  in  undergraduate  pilot  training  as  a 
criterion  for  pilot  selection,  has  proven  unsatis- 
factory as  a means  of  identifying  the  combat 
effective  pilot.  While  successfully  completing  UPT 
is  a necessary  condition  for  becoming  a pilot,  it 
is  not  a sufficient  condition  for  becoming  combat 
effective.  A performance  criterion  having  a 
stronger  relationship  to  combat  success  is  needed 
to  properly  validate  the  test  battery.  Fortunately, 
the  recent  construction  of  the  ACMR/I  facilities 
has  provided  such  a tool.  These  facilities  (see 
Section  6.2)  provide  a means  for  controlled  and 
monitored  air-to-air  combat  where  real  time  perfor- 
mance measures  can  he  accurately  determined.  The 
ideal  validation  program  would  consist  of  an  inde- 
pendent program  on  the  order  of  ACEVAL- AIMVAL  which 
evaluated  the  air-to-air  capability  of  the  pilots 
once  their  level  of  competency  was  adequate  to  han- 
dle the  intricacies  of  the  range.  Realizing  the 
cost  of  such  a program  when  applied  to  the  large 
number  of  fighter  pilots  which  are  matriculated  each 
year,  some  compromise  must  be  made.  The  prolifera- 
tion of  instrumented  ranges  seems  to  indicate  a 
greater  and  greater  emphasis  on  the  use  of  this 
type  of  facility  in  the  normal  course  of  a pilot's 
combat  crew  training.  The  data  required  to  provide 
estimates  of  pilot  performance  in  the  air  combat 
role  can  be  obtained  with  a modest  increase  in  these 
training  sorties.  It  is  also  oossihle  that  some  of 
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the  tnone  advanced  air  combat  simulators  could  be 
used  instead  of  the  air  combat  maneuvering  ranges. 
The  use  of  simulators  would  add  a certain  degree 
of  control  to  the  pilot  evaluation  program  but  at 
the  cost  of  a loss  in  the  degree  of  realism. 
Regardless  of  how  good  a simulator  is,  it  is  not 
the  same  thing  as  flying.  The  use  of  this  option 
would  require  additional  tests  comparing  performance 
on  simulators  with  performance  on  the  instrumented 
ranges.  As  indicated  in  Section  6.1,  a program  of 
simulation  paralleling  the  ACEVAL-AIMVAL  air  combat 
maneuvering  instrumentation  program  would  provide 
such  data.  The  simulation  option  is  not  recommended 
for  use  in  the  validation  program,  even  if  a high 
degree  of  relationship  is  found  between  performance 
on  the  simulator  and  performance  on  the  ACMR/I.  It 
must  be  remetrtjered  that  we  are  selecting  for  combat 
effectiveness.  The  ACMR/I  is,  at  a minimum,  one 
step  removed  from  combat  flying.  Simulation  is 
still  another  order  of  abstraction  of  the  tasks 
which  must  be  performed  in  combat,  and  may  not 
present  a true  picture  of  the  characteristics 
required  for  effective  combat  flying. 

The  execution  of  an  adequate  validation  effort 
requires  a highly  detailed  performance  assessment 
plan  which  considers  the  number  of  missions  to  be 
flown  by  each  pilot,  the  opponent  against  which 
the  mission  will  be  flown,  the  mission  scenarios, 
and  what  performance  criterion  measures  must  be 
obtained  for  the  evaluation  of  performance.  De- 
tailed protocols  for  flight  evaluation  tests  have 
been  routinely  generated  by  the  Air  Force.  An 
excellent  example  of  such  a flight  program  plan  can 
be  found  in  the  ACEVAL-AIMVAL  planning  documents 
(ACEVAL-AIMVAL,  1976)  which  are  briefly  reviewed  in 
Section  6.2.  While  the  final  definition  of  the  spe- 
cifics of  such  a plan  must  wait  until  the  scope  of 
the  entire  program  is  determined,  certain  problems, 
particularly  with  the  criteria  for  mission  success, 
should  be  noted.  One  of  the  most  important  factors 
in  evaluating  a pilot's  proficiency  is  the  specifi- 
cation of  exactly  what  you  are  evaluating  his  pro- 
ficiency against.  In  an  interactive  air-to-air 
combat  engagement,  the  capability  of  the  aggressor 
pilot  becomes  a critical  factor  in  this  evaluation. 
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Even  in  a group  of  highly  selected  pilots,  such  as 
the  aggressor  team  currently  serving  the  training 
function  at  Nellis  Air  Force  Base,  significant 
individual  differences  exist  with  respect  to  capa- 
bility. Indeed,  on  any  given  day  an  individual 
aggressor  pilot's  capability  can  be  up  or  down 
depending  upon  a number  of  undefined  variables. 

To  overcome  this  potential  for  variability  in 
aggressor  pilots,  a rigid  course  of  training  must 
be  instituted  to  make  their  performance  as  consis- 
tent as  possible  from  encounter  to  encounter.  Thus, 
if  six  engagements  per  candidate  pilot  are  planned, 
each  of  the  pilots  should  get,  as  closely  as  possi- 
ble, the  same  set  of  engagements  so  that  consistent 
test  and  evaluation  experiences  are  encountered 
across  all  candidate  pilots. 

Another  problem  in  evaluating  air-to-air  com- 
bat performance  is  the  definition  of  what  measure 
must  be  used  to  determine  success.  In  our  discus- 
sion of  simulation  reliability  in  Section  6.1.5,  we 
indicated  that  a large  number  of  measures  are  taken 
in  an  attempt  to  evaluate  performance  and  that  many 
of  these  did  not  yield  reliable  estimates  of  the 
performance  they  were  supposed  to  measure.  Of  the 
measures  reviewed,  a composite  advantage  score 
(AMLS)  derived  by  NASA,  Langley,  and  kills  were  the 
most  reliable  measures.  A measure  similar  to  AMLS 
has  been  developed  by  the  Navy  for  use  in  the  ACMR. 
While  this  measure  has  not  been  validated  as  yet, 
it  is,  in  principle,  an  excellent  way  of  obtaining 
reliable  air-to-air  combat  performance  scores.  Our 
discussions  with  instructor  pilots  indicate  that, as 
a group, they  do  not  believe  any  single  criterion 
measure,  or  group  of  criterion  measures,  now  iden- 
tified, adequately  evaluate  air-to-air  performance. 
They  believe  that  each  encounter,  while  often  simi- 
lar to  a previous  one,  is  a unique  event  and  must 
be  evaluated  on  that  basis.  While  this  may  be  true 
for  training  missions  where  specific  mistakes  can 
be  pinpointed  and  evaluated  as  illustrative  material, 
an  evaluation  program  cannot,  in  principle,  be  made 
up  of  a large  series  of  unique  and  nonrepeatable 
events.  We  believe  that  instructor  pilots  should 
have  a role  in  evaluating  the  pilot  performance  in 
this  program.  However,  procedures  must  be  defined 
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to  the  extent  that  a group  of  instructor  pilots  i 

rating  the  performance  of  a given  encounter  produce  'i 
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a consistent  evaluation.  t 
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The  use  of  novel  scoring  criteria  should  also 
be  considered.  One  suggestion  was  to  set  up  a 
series  of  scenarios  where  the  pilot  to  be  evaluated 
was  required  to  fly  against  both  average  and  excel- 
lent aggressor  opponents.  Success  criteria,  in 
this  case,  would  be  the  capability  to  beat  the  poor 
or  average  opponent  routinely  and  the  ability  to 
survive  against  the  highly  trained  superior  opponent. 

The  final  peacetime  evaluation  program  must, 
obviously,  wait  for  a definition  of  the  scope  of 
the  effort  which  could  be  funded.  Regardless  of 
the  size  of  the  effort,  however,  the  above  problems 
will  have  to  be  dealt  with  on  some  level.  Many  of 
these  answers  already  exist,  at  least  in  preliminary 
form,  and  the  major  effort  should  be  not  to  discover 
new  answers  but  to  implement,  in  a practical  fashion, 
the  state-of-the-art  techniques. 
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7.4  ACES  COMBAT  CONTINGENCY  VALIDATION  PROGRAM 
Researchers  armed  with  accurate  air  combat 
effective  selection  test  scores  and  other  related 
predictor  variables  (such  as  the  pilot's  previous 
combat  experience)  will  be  in  a position  to  vali- 
date these  predictor  scores  in  future  air  war 
confrontations. 

However,  great  care  must  be  taken  to  properly 
conduct  the  combat  kills  data  acquisition  segment 
of  this  program.  Two  global  problems  confront  the 
researcher  which  materially  influence  how  he  should 
conduct  the  research  and  what  data  he  must  collect. 

How  the  research  must  be  conducted  is  influ- 
enced by  the  very  nature  of  combat  and  the  combat 
command.  The  researchers  first  predilection,  of 
course,  is  to  exercise  some  control  over  the  situa- 
tion to  be  investigated.  The  naive  researcher 
might  well  think  that  it  was  appropriate  for  him 
to  select  particular  pilots  for  particular  combat 
missions.  In  a combat  environment,  this  interfer- 
ence with  a commander's  prerogative  would  never  be 
allowed.  The  combat  conmander  must  be  free  to 
accomplish  his  operational  assignment  in  the  manner 
in  which  he  deems  appropriate.  Consequently,  the 
researcher  is  forced  into  dealing  with  kill  records 
as  they  have  eventuated  within  the  combat  arena.'' 

This  does  not  place  the  researcher  in  an  unten- 
able position  in  the  case  of  air-to-air  combat  kills 
analysis.  It  does  mean,  however,  that  he  must  gather 
enough  reliable  data  to  allow  the  assessment  of  the 
relative  effectiveness  of  pilots  in  a situation  that 
is  contaminated  by  a number  of  artifacts.  Weiss 
(1966)  quoting  from  Tolstoy's  War  and  Peace  rather 
nicely  draws  the  picture. 

"...  What  science  can  there  be  in  a matter 
in  which,  as  in  all  practical  matters,  nothing 
can  be  defined  and  everything  depends  on 
innumerable  conditions,  the  significance  of 
which  is  determined  at  a particular  moment 
which  arrives  no  one  knows  when?" 

It  is  not  our  intent  to  overemphasize  the 
problems  associated  with  this  kind  of  research 


endeavor  but  rather  to  understand  and  underscore 
them  from  the  outset  so  that  we  can  develop  a work- 
able research  approach.  We  can  clearly  see  that  the 
research  team  must  work  on  a noninterference  basis 
with  any  fighter  command  engaged  in  combat.  However, 
we  can  identify,  at  the  outset,  the  central  data 
requirements  which  are  necessary  to  specify  adequate 
test  samples.  For  example,  we  have  discussed  the 
issue  of  opportunity  in  considerable  detail  in  this 
report  and,  certainly,  any  researcher  preparing  a 
combat  data  acquisition  plan  must  specify  a pilot's 
opportunity  for  kill  as  one  of  the  principal  data 
requirements. 

It  is  our  strong  feeling  that  any  research 
team,  even  when  armed  with  a carefully  contrived 
set  of  data  requirements,  must  be  made  up  of  at 
least  four  different  kinds  of  specialists:  first, 

qualified  research  psychologists  who  can  establish 
additional  data  requirements  which  may  be  necessi- 
tated by  a particular  set  of  operational  circum- 
stances within  any  given  area  of  air  combat  opera- 
tions; second,  combat  experienced  pilots  who,  from 
experience  with  air  warfare  operations,  can  identify 
still  other  data  requirements  that  are  peculiar  to 
the  individual  area  of  air  combat  operations;  third, 
sufficiently  senior  military  officers  armed  with  the 
appropriate  authority  to  collect  these  data  to  serve 
as  team  leaders;  and  fourth,  qualified  individuals, 
specifically  charged  with  the  responsibility  for 
complete,  thorough  documentation. 

Since  there  is  a strong  precedent  in  air  war- 
fare for  the  acquisition  and  authentication  of  data 
concerning  air  kills,  we  see  no  reason  why  combat 
validation  kills  data  cannot  be  effectively  gathered. 
It  may  be  that  the  debriefing  and  kill  authenticat- 
ing team  could  be  integrated  with  the  statistical 


“It  may  eventuate  that  the  combat  commander  will, 
in  making  pilot  assignments  to  different  types  of 
missions  (some  richer  in  kill  opportunities), 

"arti factually"  make  the  sample  of  air-to-air 
combat  pilots  more  homogeneous  with  respect  to 
their  selection  test  scores.  If  this  occurs,  it 
will  make  the  researchers'  job  more  difficult,  but 
one  they  will  have  to  live  with. 
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data  acquisition  team  we  have  already  identified. 

The  cooperation  of  the  combat  commander  should  not 
be  too  difficult  to  obtain  since,  after  all,  he 
will  be  the  first  beneficiary  of  these  data.  He 
will  be  able  to  know  which  of  his  pilots  are  doing 
the  job  for  him,  and  under  what  circumstances. 

Before  outlining  the  essential  data  require- 
ments in  the  projected  theater  of  combat  operations, 
it  should  be  noted  that  a complete  flight  history 
of  all  pilots  in  any  combat  sample  should  be  devel- 
oped. Data  from  both  Korea  and  Southeast  Asia  indi- 
cate that  a pilot's  flight  history  in  terms  of 
number  of  flight  hours,  previous  combat,  etc.,  has 
been  related  to  combat  effectiveness. 

We  have  drawn  upon  the  Strawbridge  and  Kahn 
(1955)  study  of  combat  effectiveness  in  the  air 
war  in  Korea  as  a model  for  developing  the  data 
requirements  inherent  in  the  scientific  and  rigor- 
ous combat  data  collection  program.  Valuable 
guidelines  can  be  drawn  from  their  work  with 
respect  to  the  acquisition  of  appropriate  data, 
and  alternative  approaches  to  the  analysis  of 
factors  which  have  influenced  the  reliability  of 
these  kinds  of  data.  We  will  use  approaches  devel- 
oped in  their  article  in  defining  the  combat  data 
requirements.  These,  as  well  as  some  data  require- 
ments needed  to  insure  the  reliability  of  the  data, 
are  summarized  here  in  the  text  and  in  Figure  7.4-1. 

Strawbridge  and  Kahn  (1955)  begin  their  approach 
by  identifying  the  type  of  mission  as  an  influence  on 
kill  opportunities.  In  Korea  they  reported  that; 

".  . . Most  MIGs  were  encountered  on  counter- 
air missions  to  MIG  Alley,  such  missions  afford- 
ed greatest  opportunity  for  the  individual  to 
perform.  A pilot  who  flew  a disproportionately 
large  number  of  reconnaissance.  . . or  rescue 
missions  had  much  less  opportunity  to  contact 
the  enemy.  Further,  although  a pilot  may  have 
flown  a large  number  of  counterair  missions  to 
MIG  Alley,  if  he  was  assigned  the  flight  posi- 
tion of  wingman,  his  role  was  largely  defensive 
and  he  had  little  opportunity  to  initiate  fire 
on  the  enemy.  It  is  clear  that  those  pilots 
who  flew  counterair  missions  to  MIG  Alley  as 
flight  or  element  leaders  had  greatest  oppor- 
tunity. 


".  . .The  tactical  situation  affected  a pilot's 
opportunities.  The  presence  of  an  enemy  in 
MIG  Alley,  the  ratio  of  friendly  to  enemy 
planes,  the  distance  of  the  enemy  at  time  of 
sighting,  the  disposition  of  the  enemy  for  com- 
bat, all  of  these  affected  a pilot's  opportun- 
ities. A pi’ot  may  have  been  leader  of  a coun- 
ter-air mission  to  MIG  Alley,  but  if  an  enemy 
were  grounded  or  if  they  were  disposed  to  seek 
sanctuary  behind  the  Yalu  River,  no  contact 
could  be  made."  (p.  15) 

"[However,].  . . a successful  patrol  can  be 
thought  of  as  a linear  sequence  ot  events: 
sighting  the  enemy,  encountering  the  enemy, 
firing  on  the  enemy,  and  destroying  the  enemy." 
(p.  14) 

From  these  observations,  Strawbridge  and  Kahn 
(1955)  identified  total  missions  (M),  sightings  as 
leader  (S),  encounters  as  leader  (E),  firings  (F), 
and  weighted  kills  (K)  as  critical  combat  data 
requirements.  A more  detailed  description  of 
these  data  requirements  may  be  found  in  Section 
3. 2. 2. 2.  To  these  requirements  we  would  add  the 
corollary  wingman  data.  Figure  7.4-1  shows  a pre- 
liminary or  provisional  identification  of  the  data 
requirements  that  are  keyed  to  a quantitative  thor- 
oughgoing analysis  of  combat  effectiveness.  Many 
of  the  data  requirements  are  the  obvious  ones,  e.g., 
number  of  missions,  number  of  kills.  Other  data 
requirements  are  directed  at  issues  affecting  oppor- 
tunity for  kills  while  still  others  affect  the  over- 
all reliability  of  the  kills  data.  The  "Comments" 
column  in  Figure  7.4-1  provides  thumbnail  descrip- 
tions of  why  the  particular  data  item  is  important, 
particularly,  whether  it  relates  to  the  key  data 
analysis  of  kills,  or  it  is  collected  as  a data 
requirement  to  sort  out  confounding  issues  such  as 
opportunity,  or  flight  position. 

The  ACES  Combat  Contingency  Validation  Program 
which  we  have  sketched  out  here  is  clearly  provi- 
sional. However,  it  does  supply  a usable  departure 
point  for  a more  carefully  contrived  plan.  Air 
Force  efforts,  both  in  World  War  II  and,  particu- 
larly, Korea,  were  "reflex  actions."  In  spite  of 
this,  the  products  coming  from  both  World  War  II  and 
particularly  the  Korean  conflict,  were  excellently 
conceived  and  executed.  Indeed,  they  form  a large 
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basis  of  what  we  can  say  factually  about  the  factors 
contributing  to  air  combat  effectiveness.  However, 
the  researchers,  through  no  real  fault  of  their  own, 
had  only  very  limited  relevant  information  on  the 
pilots  prior  to  their  entry  into  combat. 


If  the  ACES  program  recommended  in  this  report 
is  implemented,  researchers  will  be  armed  with 
selection  test  scores  in  virtually  all  of  the 
domains  or  dimensions  presumed  to  underlie  combat 
effectiveness.  Armed  with  these  test  scores  and 
an  effectively  executed  combat  data  acquisition 
validation  program,  researchers  will,  for  the  first 
time  in  history,  be  able  to  specify  a definitive 
profile  of  the  ace  fighter  pilot. 
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7.5  SOWARy 

In  Section  4,  35  factors  not  adequately 
assessed  within  an  existing  pilot  selection  program 
were  recommended  for  inclusion  in  the  profile  of 
the  confcat  effective  fighter  pilot.  Thirty-three 
of  these  factors  could  be  evaluated  upon  entrance 
into  pilot  training.  The  remaining  two  factors 
(quality  of  combat  decisions  and  flight  skills) 
can  best  be  tested  at  the  end  of  pilot  training  or 
in  advanced  training. 

A cost  effectiveness  analysis  of  selection 
tools  for  assessing  these  33  factors  was  performed. 
This  analysis  was  based  upon  four  criteria: 

a.  Cost  of  application. 

b.  Ease  of  administration  and  impact  on  the 
present  selection  program- 

c.  Objectiveness  of  scores- 

d.  Historical  validity  of  test  instruments 
as  means  of  measuring  a particular  selec- 
tion factor. 


objective  performance  measures  obtained  in  real 
time  can  be  monitored. 

The  second  phase  of  the  ACES  program  is  the 
ACES  Combat  Contingency  Validation  Program,  a com- 
bat validation  plan.  In  developing  the  critical 
data  requirements  for  this  program,  the  Strawbridge 
and  Kahn  (1955)  study  of  air  combat  effectiveness 
during  the  Korean  conflict  was  used  as  a model. 
These  include  the  number  of  total  missions,  sight- 
ings as  leader,  encounters  as  leader,  firings,  and 
weighted  kills.  A more  detailed  listing  of  these 
data  requirements  may  be  found  in  Figure  7.4-1. 

The  end  result  of  the  ACES  program  would  be  a 
definitive  profile  of  the  ace  fighter  pilot. 


Of  seven  test  instruments  which  were  evaluated, 
five  were  found  to  be  cost  effective  (paper-and- 
pencil  tests,  peer  and  instructor  ratings,  situa- 
tional tests,  small  apparatus  tests,  and  job  sample 
tests).  Paper-and-pencil  tests  were  recommended 
for  evaluating  five  factors,  small  apparatus  and 
job  sample  tests  for  evaluating  13  factors,  and 
situational  tests  and  ratings  for  evaluating  15 
factors.  A detailed  list  of  the  factors  to  be 
tested  with  these  selection  tools  may  be  found  in 
Figure  7.2-1.  i 

An  air  combat  effectiveness  study  (ACES)  pro- 
gram is  recommended  which  consists  of  two  phases. 
One  phase  is  the  ACES  Air  Combat  Maneuvering  Range 
Assessment  Program,  a peacetime  validation  plan. 

In  order  to  adequately  validate  the  pilot  selection 
test  battery,  criteria  more  closely  related  to  com- 
bat performance  than  measures  of  success  in  train- 
ing are  required.  Air  combat  maneuvering  range/ 
instrumentation  facilities  provide  a means  of 
developing  such  criteria.  Using  these  facilities, 
air-to-air  combat  conditions  can  be  controlled  and 
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PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 

8.0  FINAL  SUMMARY 

This  study  has  examined  the  issue  of  finding 
a more  efficient  method  for  selecting  combat  effec- 
tive fighter  pilots.  Our  research  has  identified 
a program  which  could  be  implemented  for  the  selec- 
tion of  individuals  at  entrv  into  the  military  who 
would  prove  to  be  effective  air-to-air  pilots. 

Significant  differences  in  individual  capa- 
bility have  been  found  between  pilots  using  equiv- 
alent equipment.  During  peacetime,  the  combat 
effective  pilots  would  demonstrate  their  effec- 
tiveness in  air  combat  maneuvering  range  engage- 
ments. We  believe  that  these  individuals  will  have 
the  characteristics  of  those  who  will  be  success- 
ful in  the  combat  arena. 

Approximately  five  years  of  rigorous  work, 
costing  about  as  much  as  a single  modern  fighter 
aircraft,  would  be  required  to  develop  such  a pro- 
gram. The  development  of  a program  of  this  nature 
would  require  the  execution  of  several  phases. 

These  include  a Job  analysis  of  the  fighter  pilot 
task,  the  generation  of  testable  trait  hypotheses, 
the  development  of  predictors  and  peacetime  and 
combat  criteria,  and  validation  and  cross  valida- 
tion during  peacetime  and  combat.  The  following 
phases  were  completed  in  this  study: 

a.  An  extensive  and  comprehensive  job  analy- 
sis of  the  fighter  pilot  using  information 
obtained  from  validity  studies,  inter- 
views, and  questionnaires. 

b.  The  development  of  testable  trait  hypoth- 
eses covering  12  content  domains. 

c.  A cost  effectiveness  analysis  of  selec- 
tion tools  for  testing  these  trait 
hypotheses. 

d.  An  evaluation  of  the  reliability  of  mea- 
sures in  simulators  and  in  air  combat 
maneuvering  ranges/instrumentations  for 
the  development  of  peacetime  criteria. 
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the  develooment  of  combat  criteria. 


Additionally,  programs  were  outlined  for  the  execu- 
tion of  the  peacetime  and  comba.  validation  phases. 

Five  major  sources  of  information  were  used  to 
generate  a comprehensive  profile  of  the  combat 
effective  fighter  pilot.  A review  of  World  War  II, 

Korean,  and  Southeast  Asian  combat  data  was  com- 
pleted as  was  a review  of  U.S.  military  aviation 
selection  research  dating  from  World  War  II  to  the 
present  time  which  focused  upon  the  characteristics 
and  critical  skills  predicting  success  in  flight 
training.  The  latter  1 iterature  was  used  as  a source 
of  hypothesis  generation  since,  by  implication, 
these  factors  might  be  related  to  combat  effective- 
ness. We  also  reviewed  the  German  and  Japanese 
World  War  II  aviation  selection  research  programs 
as  well  as  the  current  Israeli  program.  The  final 
source  of  information  was  the  set  of  questionnaire 
responses  which  were  returned  to  us  by  373  fighter 
pilots. 

Using  the  data  and  inputs  from  these  five  1 

sources,  we  created  an  integrated  profile  of  the  | 

combat  effective  fighter  pilot.  In  all.  45  factors 

■ ' 

distributed  among  12  major  domains  {medical/physio- 
logical; aptitude;  decision  making;  sensory-motor 
abilities;  aviator  skills,  knowledges,  and  tasks; 
personality;  personality-leadership;  movitvation; 
reactions  to  stress;  risk  taking;  social  factors; 
and  biographical  data)  can  be  hypothesized  to  be 
of  predictive  value  in  identifying  the  combat  effec- 
tive fighter  pilot.  Of  these  45  factors,  35  are  not 
adequately  assessed  in  the  entry  selection  program 
of  the  U.S.  Air  Force.  Since  the  technological 
basis  for  testing  the  majority  of  these  hypothe- 
sized predictor  variables  is  at  hand,  we  believe 
that  a reasonable  case  has  been  made  for  the  overall 
feasibility  of  such  a program. 

The  most  cost-effective  selection  test  instru- 
ment for  each  particular  hypothesized  predictor 
variable  was  indicated.  We  found  that  an  entry 
selection  program  could  test  for  33  of  the  35 
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hypothesized  predictor  variables  currently  not 
sufficiently  tested  by  the  U.S.  Air  Force.  This  is 
a major  finding  of  this  study. 

We  have  formulated  an  ACES  Selection  Test 
Program  which  would  test  for  the  33  factors  listed. 
We  conceptualize  such  a selection  test  program  as 
being  similar  to  the  current  Israeli  program,  but 
more  comprehensive.  The  ACES  testing  program  could, 
after  development,  be  conducted  at  a single  site 
with  candidates  being  tested  during  a seven  to  ten 
day  period. 

Once  the  selection  test  scores  have  been  col- 
lected, candidate  pilots  would  progress  normally 
through  conventional  pilot  training  to  a point 
where  a substantial  number  of  them  could  be  placed 
in  the  ACES  Pilot  Air  Combat  Maneuvering  Range 
Performance  Assessment  Program.  Here  the  pilots 
would  fly  against  specially  trained  instructor 
pilots  in  a series  of  carefully  contrived  air  com- 
bat scenarios.  Well-defined  and  accurately  meas- 
ured criterion  scores  would  be  generated  as  a 
measure  of  each  pilot's  combat  effectiveness. 

After  the  peacetime  data  collection  phase  is  com- 
pleted, correlations  between  pilots'  combat  effec- 
tiveness scores  and  ACES  Selection  Test  Program 
scores  could  be  used  to  evaluate  the  predictive 
power  of  the  ACES  Selection  Test  Program.  If, 
upon  analysis,  adequate  correlations  exist  between 
pilot  selection  test  scores  and  measures  of  per- 
formance during  dissimilar  air  combat  testing, 
then  there  will  exist,  during  peacetime,  a way  of 
selecting  pilots  who  will  perform  adequately  in  a 
necessary  condition  for  combat  success.  Combined 
with  appropriately  small  selection  ratios,  the 
probability  of  picking  combat  effective  pilots 
can  be  greatly  enhanced. 

Finally,  we  have  prepared  a Combat  Contingency 
Validation  Plan.  If  a war  should  eventuate,  we 
would  relate  the  pilot's  scores  in  both  the  ACES 
Selection  Test  Program  and  the  ACES  Pilot  Air 
Combat  Maneuvering  Range  Performance  Assessment 
Program  with  performance  in  actual  combat.  The 
combat  contingency  validation  plan  includes  a 


specification  of  the  combat  data  requirements  for 
adequate  evaluation  of  the  combat  effectiveness  of 
individual  pilots,  uncontaminated  by  such  issues 
as  opportunity. 

The  ACES  Combat  Contingency  Validation  Program 
which  we  have  sketched  here  is  provisional.  We 
have,  however,  specified  a reasonable  departure 
point  for  a more  carefully  designed  plan.  No  pre- 
war contingency  research  plans  were  available  for 
World  War  II  or  for  Korea.  Despite  this,  the 
products  coming  from  both  air-to-air  conflicts  were 
quite  useful.  Without  a good  plan,  however,  only 
very  limited  relevant  information  on  the  pilots 
was  available  prior  to  their  entry  into  combat. 

If  the  ACES  program  is  implemented,  research- 
ers will  have  selection  devices  assessing  the 
dimensions  presumed  to  underlie  combat  effective- 
ness. The  military  aviation  research  community 
would,  for  the  first  time  in  history,  be  in  a 
position  to  specify  an  accurate  profile  of  the 
combat  effective  fighter  pilot. 
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9.0  GLOSSARY.  REFERENCES.  AND  SUPPLEMENTAL 
BIBLIOGRAPHY 

9.1  GLOSSARY 

A-4  - Navy  ground  attack  aircraft 
A-6  - Navy  ground  attack  aircraft 
A-7  - Air  Force  ground  attack  aircraft 
A- 10  - Air  Force  ground  attack  aircraft 
AAF  - Army  Air  Force(s) 

A/A  - Air-to-Air 

AAA  - Anti-Aircraft  Artillery 

AAFQE  - Army  Air  Force's  Qualifying  Examination 

AB  - Afterburner 

AC  - Ai rcraft  or  Ai rcraft  Commander 

ACB  - Aircrew  Classification  Battery 

ace  - ordinarily,  an  American  or  Allied  pilot  with 
five  or  more  aerial  victories 

ACES  Program  - Air  Combat  Effectiveness  Study 
Program 

ACEVAL  - Air  Combat  Evaluation 

ACEVAL-AIMVAL  - Air  Combat  Evalaution  - Air 
Intercept  Missile  Evaluation 

ACF  - Advanced  Conventional  Fighter 

ACM  - Air  Combat  Maneuver(ing) 

ACMI  - Air  Combat  Maneuvering  Instrumentation 

ACMR  - Air  Combat  Maneuvering  Range 

ACMR/I  - Air  Combat  Maneuvering  Range/Instrumentation 

ACMS  - Air  Combat  Maneuvering  Simulator 

ADF  - Advanced  Day  Fighter 

ADI  - Attitude  Director  Indicator 

AFB  - Air  Force  Base 

AFHRL  - Air  Force  Human  Resources  Laboratory 

AFOQT  - Air  Force  Officer  Qualifying  Test 

AFTI  - Advanced  Fighter  Technology  Integration 

AFWAB  - Army  Fixed  Wing  Aptitude  Battery 

AGL  - above  ground  level 

AIG  - Aircraft  Image  Generation 

AIM  - Air  Intercept  Missile 


AIMVAL  - Air  Intercept  Missile  Evaluation 
AIP  - Advanced  Instructional  Provisions 
AIS  - Aircraft  Instrumentation  Subsystem 
AMAS  - Alternate  Manifest  Anxiety  Scale 
AML  - Adaptive  Maneuvering  Logic 
AMLS  - Adaptive  Maneuvering  Logic  Score 
AoA  - Angle  of  Attack 
AQT  - Aviation  Qualifying  Test 

ARMA  - Adaptability  Rating  for  Military  Aeronautics 

ARI  - Army  Research  Institute 

ARPA  - Defense  Advanced  Research  Projects  Agency 

ASDB  - Army  Self-Description  Blank 

ASUPT  - Advanced  Simulator  for  Undergraduate  Pilot 
Training 

ATC  - Air  Training  Command 

ATT  - Advanced  Technology  Threat 

AV-8A  - designation  code  number  of  the  Harrier 
ai  rcraft 

Axis  Sally  - turncoat  propaganda  broadcaster  for 
Germans  in  World  War  II 

B-17;  8-29  - American  bombers  used  in  World  War  II 
and  Korea 

Bell  206-Jet  Ranger  - helicopter  "trainer"  used 
by  the  Israelis 

BFM  - Basic  Flight  Maneuvering 

Betty  - World  War  II  - (designation)  Japanese 
bombers 

BI  - Biographical  Inventory 
BPI  - Bits  per  Inch 

Britten-Norman  Islander  - aircraft  used  by  Israelis 

for  navigator  training 

CAA  - Civil  Aeronautics  Administration 

CAP  - Combat  Air  Patrol 

CCS  - Control  and  Computation  Subsystem 

CCTS  - Combat  Crew  Training  School 

CDC  - Control  Data  Corporation 

CEP  - Circular  Error,  Probable 

CG  - Center  of  Gravity 
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Chofu  unit  - designation  (location)  of  key  Japanese 

aviation  selection  test 
unit  in  World  War  II 

CO  - Commanding  Officer 

Corsair  - gull  wing  Navy  and  Marine  fighter  air- 
craft of  World  War  II 

CPI  - California  Personality  Inventory 

CPM  - Cards  per  Minute 

CRT  - Cathode  Ray  Tube 

Dassault  Breguet  Mirage  - Advanced  jet  fighter 

aircraft  used  by  Israelis 

DC  or  dc  - Direct  Current 

DCS  - Deputy  Chief  of  Staff 

DDS  - Display  and  Debriefing  Subsystem 

DF  - direction  finder/finding 

DLC  - Direct  Lift  Control 

DM  - Drag  Modulation 

DMS  - Differential  Maneuvering  Simulator 
DMT  - Defense  Mechanism  Test 
DOB  - Differential  Officer  Battery 
DOR  - Drop  on  Request 

Domier  Do27  - light  twin  engine  plane  used  to 
train  some  Israeli  pilots 

Doves  - ineffective  combat  pilots;  those  having  a 
high  probability  of  being  shot  down 

Draw  a Man  Tests  - standard  psychological  tests  in 
which  testee  draws  or  completes 
a drawing  of  a person;  a nonver- 
bal test  of  intelligence 

DSC  - distinguished  service  cross 

DSFC  - Direct  Side  Force  Control 

EPI  - Eysenck  Personality  Inventory 

EPPS  - Edwards  Personal  Preference  Schedule 

F-4  - American  triservice  fighter  bomber 

F-8  - Navy  fighter 

F-14  - modern  Navy  fighter  aircraft 

F-15  - modern  Air  Force  fighter  aircraft 

F-86  - American  jet  fighter  aircraft  used  exten- 
sively during  the  Korean  War;  the  Sabre 

F-1DD  - vintage  Air  Force  jet  fighter  aircraft 


COOTMMViiTVOW 

F-1D5  - Air  Force  fighter 

FAST  - Flight  Aptitude  Selection  Test 

FAR  - Flight  Aptitude  Rating  (scale) 

FAR  - Fighter/Attack/Reconnaissance 

FIP  - Flight  Indoctrination  Program 

F.I.W.  - Fighter  Interceptor  Wing 

Flak  - antiaircraft  fire;  drawn  from  the  German 
acronym 

Fouga  Magister  - French  designed.  Israeli  manu- 
factured jet  trainer 

FW-19D  - World  War  II  German  fighter  aircraft 

FWC  - Fighter  Weapons  Center  (Nellis  AFB) 

G- ratings  - an  overall  assessment  of  pilot 
proficiency 

GA  - Gust  Alleviation 

GAT-1  - General  Aviation  Trainer,  No.  1 

GCA  - Ground  Control  Approach 

GCI  - Ground  Control  Intercept 

GIT  - General  Information  Test 

GPl  - Gordon  Personality  Inventory 

GZTS  - Guilford-Zimmerman  Temperament  Survey 

MAC  - High  Acceleration  Cockpit 

HAF  - High  Acceleration  Fighter 

Hamps  - World  War  II  Japanese  Warplane  (designation) 

HAS  - Heineman  Anxiety  Scale 

Hawks  - superior  air-to-air  fighter  pilots 
(re  Weiss,  1966) 

HSI  - Horizontal  Situation  Indicator 
HUD  - Head  Up  Display 

HumRRD  - Human  Resources  Research  Drganization 
lAF  - Israeli  Air  Force 
ID  - identification 

IDIIDM  - Information  Displays  Incorporated  Input/ 
Dutput  Machine 

I/O  - Input/Dutput 

IDD  - Interest-Dpinion  Duestionnaire 
IP  - Instructor  Pilot 
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IQ  - Intelligence  Quotient 

IR  - Infrared  , 

JAAF  - Japanese  Army  Air  Force 

JG  - Jaqdgeschwader  (German  Fighter  Wing) 

108  to  144  aircraft 

JNAF  - Japanese  Navy  Air  Force 

Kamakaze  pilots  - Japanese  suicide  pilots  of  World 
War  II;  the  Devine  Wind 

KCAS  - Knots  Calibrated  Air  Speed 

Kfir  - Israeli  front  line  air-to-air  fighter 
ai rcraft 

KIA  - Killed  in  Action 

Koku  Tekisei  Kensabu  - World  War  II  Japanese 
aviation  test  unit 

KPR  - Kuder  Preference  Record 

LLLTV  - Low  Light  Level  Television 

LQT  - Large  Quantity  Threat 

LTV  - Ling  Temco  Vought,  Inc. 

Luftwaffe  - the  German  Air  Force 

MACS  - Manned  Air  Combat  Simulator 

MCAIR  - McDonnell  Aircraft  Company 

MCT  - Mechanical  Comprehension  Test 

MDC  - McDonnell  Douglas  Corporation 

ME-109  - World  War  II  German  fighter  aircraft 

ME-262  - German  twin  engine  jet  used  as  a fighter 
aircraft  during  the  last  period  of  World 
War  II 

MEC  - Maneuver  Enhancement  Control 

MIB  - Military  Interest  Blank 

MIG  - designation  of  Russian  fighter  aircraft 

MIG-17  - Russian  fighter  aircraft  also  designated 
as  Fresco 

MIG-21  - Russian  fighter  aircraft  also  designated 
as  Fishbed 

MIGCAP  - MIG  Combat  Air  Patrol 

Mirage  - French  built  front  line  Israeli  fighter 
ai rcraft 

MIT  - Military  Information  Test 

MMPI  - Minnesota  Multiphasic  Personality  Inventory 

MSL  - mean  sea  level 


MSS  - Missile  Simulation  Subsystem 

NASA  - National  Aeronautics  and  Space  Administration 

Nates  - World  War  II  Japanese  fighter  aircraft 
(designation) 

NATOPS  - Navy  Air  Training  and  Operating  Procedures 
Standardization 

NAVAIR  SYS  COM  - Naval  Air  Systems  Command 

NCO  - Noncommissioned  Officer 

NMI  - nautical  miles 

NVN  - North  Vietnam 

NRC  - National  Research  Council 

OCS  - Officer  Candidate  School 

OER  - Officer  Efficiency  Report 

Ord.  - ordnance 

ORO  - Operations  Research  Office 
OSS  - Office  of  Strategic  Service 
P - pilot 

P-38,  39,  40,  47,  51  - American  fighter  aircraft 
of  World  War  1 1 

Pearsonian  r - Pearson  product  moment  correlation 
coefficient 

Piper-PA-18-150  - light  aircraft  used  by  Israelis 
in  early  flight  training 

PK  - Probability  of  kill 

POW  - Prisoner  of  War 

PRB  - Personnel  Research  Branch 

Psychotechnics  - Applied  Psychology,  e.g.,  in 
aviation  selection 

RAF  - Royal  Air  Force  (Britain) 

R&R  - rest  and  recuperation 

RCAF  - Royal  Canadian  Air  Force 

RDTMS  - Rated  Distribution  Training  Management 
System 

Recce  - reconnaissance 

Red  Baron  Reports  - see  WSEG  in  Reference  Section. 

SEA  study  program  concerning 
air  effectiveness 

Red  Flag  Program  - Triservice  Combat  Readiness 
Program  being  conducted  at 
Nellis  AFB 

RIPS  - Real  Image  Projection  System  ' 
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River  Rat  - member  of  the  Red  River  Valley  Fighter 
Pilots  Association;  must  have  flown 
missions  over  South  Vietnam 

ROTC  - Reserve  Officer  Training  Corps 

RTU  - Replacement  Training  Unit 

SAC  - Strategic  Air  Command 

SAM  - U.S.  Air  Force  School  of  Aviation  Medicine 
or  surface-to-air  missile 

SAAC  - Simulator  for  Air-to-Air  Combat 


SAS  - Stability  Augmentation  System 

SAT  - Spatial  Apperception  Test 

SCDC  - Simulation  Control  and  Data  Center 

SE  - standard  error  of  measurement 

SEA  - Southeast  Asia 

Sortie  - one  mission  by  a single  plane 

SOCON  - Self-Other  Concept  Test 

Split  S - standard  aerobatic  combat  maneuver 

STG  - Synthetic  Terrain  Generation 

Stuka  - German  dive  bomber  used  throughout  World 
War  II 

TA-4  - trainer  version  of  the  A-4  aircraft 
TAC  - Tactical  Air  Command 

TAC  ACES  II  - Pilot  training  evaluation  study  using 
the  simulator  for  air-to-air  combat 


TACAN  - Tactical  Air  Navigation 

TAT  - Thematic  Apperception  Test 

TIS  - Tracking  Instrumentation  Subsystems 

TMAS  - Taylor  Manifest  Anxiety  Scale 

TO  - Time-on-Offense 

TOA  - Time  on  Offense  with  Advantage 

TOPLINE  - Air  Force  Personnel  Plan 

Top  Gun  - Navy  air  combat  training  program 

TTB  - Transport/Tanker/Bomber 

TV  - Television 

UHF  - Ultra  High  Frequency 

UPT  - Undergraduate  Pilot  Training 
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APPENDIX  3. A 

STATISTICAL  CALCULATIONS  FOR  THE 
ANALYSIS  OF  CHANCE  ISSUES  AS  THEY 
RELATE  TO  AIR-TO-AIR  KILLS 
SHOWN  IN  SECTION  3.0 


the  probability  of  a failure 
(assumed  to  be  .5) 


We  could  calculate 


3.A.1  NUMERICAL  CALCULATIONS  FOR  KOREAN  WAR 
DATA:  PROBABILITY  OF  OBTAINING  792  ENEMY  KILLS 

AND  78  USAF  LOSSES  IN  870  ENCOUNTERS 

3. A. 1.1  Using  the  General  Formula  for  Chi 
Square: 

x2  = E (f-F)2/F 

where 

f ' Observed  Frequency  (kills  or  losses) 

F = Expected  Frequency  (kills  or  losses  based 
upon  chance) 

We  calculate 

= (792-435)2  + (78-435)2 
435 


= (357)2  + (-357)2 

435  435 

293  + 293 


p = '5^^^  plus  77  similar  terms. 

Alternately  we  have  chosen  to  compute  a normal 
approximation  to  the  binomial  applying  the  Central 
Limit  Theorem,  thus: 


p(r  1 X n)  = p(r  -i  l X £ n +^)  which 
can  be  computed.  . . 


p(X 


. /IlA). 

- ' P \ 


where 

u = the  mean 
o2  = the  variance 

Z = the  standardized  normal  variate 


We  calculate 
n = 870 
p = .5 

u = 870  (.5)  = 435 
o2  = 870  (.5)  (.5)  = 217.5 


x2  = 586,  df  = 1,  p < .001 

Rejection  of  the  null  hypothesis  (i.e.,  observed 
frequencies  lie  within  chance  expectations)  re- 
quires a Chi  Square  value  of  10.83  at  the,  .001 
level  of  significance.  _ 


. /791.5  -435  , 870.5  -435\ 

P(X1  792)  =p^  /m:5  ) 

Z356.5  , ,,  435.5\ 


435.5\ 

wnj 

p(24.17  < Z < 29.53) 


3. A. 1.2  Using  an  Approximation  to  the  Binom-  which  is  less  than  0.0000001. 

ial  Probability:  The  exact  probability  of  as  ex- 
treme or  more  extreme  a result  may  be  computed 
using  the  binomial  probability  formula; 


where 

n 

r 

P 


n 


the  number  of  events  (encounters) 

the  number  of  successes  in  n trials 

the  probability  of  a success 
(assumed  to  be  .5) 
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3. A. 2 NUMERICAL  CALCULATIONS  FOR  SOUTHEAST  ASIA 
KILL  DATA*:  PROBABILITY  OF  OBTAINING  131  ENEMY 
KILLS  AND  AN  ESTIMATED  (FROM  THE  OPEN  LITERATURE) 
55  USAF  AIR-TO-AIR  LOSSES  IN  186  ENCOUNTERS 


We  calculate 


V } 


3. A. 2.1  Using  the  General  Formula  for  Chi 


Square: 


We  calculate 


x2  = E (f-F)2/F 


/37.5  , 93. S\ 

p(o?  ^ O?) 


p (5.49  < Z < 13.71) 


= (131-93)^  + (55-93) 
93  93 


which  is  less  than  0.0000001. 


(38)^  + (-38)^ 
93  91^ 


15.52  + 15.52 

I x^  = 31.04.  df  = 1.  p < .001 

Rejection  of  the'null  hypothesis  (i.e.,  observed 
frequencies'  lielwithin  chance  expectations) 
requires  a Chi  Square  value  of  10.83  at  the  .001 
level  of  significance. 


3. A. 2. 2 Using  an  Approximation  to  the 
Binomial : 

p (X  > r)  = p ( < Z < ” 

i /o2  i/o2  / 


n = 186 

p = .5  ' 

u = 186  (.5)  = 93 
= 186  (.5)  (.5)  = 46.5 


•See  Section  3.0,  p. 
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APPENDIX  3.B 

DESCRIPTION  OF  THE  PERSONNEL  RESEARCH  BRANCH 
EXPERIMENTAL  BATTERY* 


3.B.1  PERSONALITY  INSTRUMENTS 


3.B.1.1  Anny  Self-Description  Blank  (ASDB) 
(Recruit)  - A 279-item  personality  questionnaire 
consisting  of  items  found  valid  on  the  basis  of 
Arctic,  Korean,  and  other  item  analysis  data.  The 
first  50  items  are  the  most-least  type  of  forced- 
choice  based  on  25  quintets  of  phrases.  The  next 
183  items  are  of  the  Yes-No  type,  and  the  final 
46  items  consist  of  forced-choice  pairs. 


3.B.1.2  Army  Self-Description  Blank  (ASDB) 
R-II  - A suppressor  instrument,  consisting  of  150 
Yes-No  personality  items  believed  on  the  basis  of 
previous  item-analysis  data  to  have  possible 
suppressor  characteristics  (high  correlation  with 
the  valid  material,  but  low  correlation  with  the 
criterion) . 


3.B.1.3  Interest-Opinion  Questionnaire  (lOQ) 
HumRRO's  personality  instrument,  derived  from  a 
multiplicity  of  source  instruments,  resulting 
from  its  Korean  Fighter- Factor  item  analyses, 
consisting  of  286  items  in  seven  sections,  each 
section  using  a different  item  type. 


3.B.1.4  General  Information  Test  (GIT)  - A 
test  developed  under  contract  designed  to  measure 
interest  in  mascul ine-type  outdoor  activities 
(including  military  matters)  by  tapping  knowledge 
that  would  presumably  have  been  gained  almost 
entirely  by  actual  participation.  There  are  100 
"positive"  type  items;  and  20  "negative"  or  sup- 
pressor type  items,  tapping  a "bookworm"  or 
"dilettante"  component. 


3.B.2  REASONING  TESTS 


3.B.2.1  Practical  Situations  Test  - A timed 


25-item  verbal  reasoning  test  attempting  to  measure 


•From  Willemin,  Birnbaum,  and  Rosenberg  (1957) 
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ability  to  solve  practical  problems,  utilizing  4- 
choice  questions. 


3.B.2.2  Related  Forms  Test  - An  84- item  non- 


verabl  reasoning  test  printed  directly  on  the 
machine-scored  answer  sheet.  In  28  groups  of  three 
items  each,  it  requires  the  classification  of  each 
item  (a  geometrical  pattern)  into  Type  A or  Type  B 
according  to  a set  of  model  oattems,  with  each  of 
the  28  groups  having  its  own  set  of  Type  A and  Type 
B model  patterns. 


3.B.3  PERCEPTUAL  SPEED  TESTS 


3.B.3.1  Reaction  to  Signals  Test  - A two-part, 
210-item  test  of  coding  speed  requiring  the  examinee 
to  mark  predesignated  combinations  of  answers  spaced 
for  each  item,  according  to  a geometrical  code  signal 
(e.g.,  a triangle  means  to  mark  A,  B,  and  C).  Part  I 
receives  one  minute  of  practice  and  four  minutes  of 
test  time;  Part  II  receives  two  minutes  of  practice 
and  four  minutes  of  test  time. 


3.B.3.2  Dials  Test  - A two-part,  60-item  per- 
ceptual speed  test  in  which  each  item  requires  the 
examinee  to  detect  which  one  of  four  dial  readings 
is  in  a danger  zone  as  shown  by  shaded  areas  in  four 
corresponding  master  dials. 


3.B.3.3  Army  Perceptual  Speed  Test,  Form-2  - 
A 48-item  test  printed  directly  on  the  machine- 
scored  answer  sheet,  in  which  each  set  of  four  items 
requires  the  examinee  to  match  four  groups  of  sketched 
objects  with  the  proper  four  of  five  sketch  groups 
from  which  they  are  taken. 


3.B.3.4  Attention  to  Detail  Test  - A 60- item, 
hand-scored  perceptual  speed  test  of  the  "C- 
cancellation"  type,  scored  rights  only. 


3.B.4  perception  IN  DISTRACTION  TESTS 


3.B.4.1  Object  Comp'letion  Test  - A five-part, 
75-item  visual  test  requiring  the  examinee  to  recog- 
nize line  drawings  of  military  objects  through  check- 
ered masks  concealing  75%,  90%,  75%,  90%,  and  75%  of 
each  picture  in  the  respective  parts. 
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3.B.4.2  Location  Test  - A 48- item  visual  test 
consisting  of  sets  of  four  small  photographs,  each 
set  being  accompanied  by  a large  photograph  having 
five  lettered  locations  marked.  The  examinee  is 
required  to  identify  the  lettered  location  in  the 
large  photograph  from  which  each  of  the  four  small 
photographs  was  taken.  Six  of  the  twelve  sets  of 
four  small  photographs  are  darkened  to  give  a 
"night"  effect. 

3.B.4.3  Recognition  Test  - A combination 
visual  and  auditory  test  in  three  parts  of  25  items 
each,  requiring  the  examinee  to  recognize  in  each 
item  which  one  of  five  drawings  is  being  described 
on  recorded  tape,  the  recorded  descriptions  being 
accompanied  by  a variety  of  loud  and  annoying  back- 
ground sounds. 

3.B.4.4  Ueapons  Idenfication  Test  - An  audi- 
tory test  recorded  on  tape,  which  teaches  five 
weapons  sounds  to  a point  approaching  saturation, 
and  then  tests  the  examinee's  recognition  of  these 
weapons  in  ten  parts  of  15  items  each.  The  parts 
are  arranged  in  cyclical  order,  with  Parts  1,  4, 

7,  and  10  being  the  easiest.  Parts  2,  5,  and  8 
having  the  items  in  somewhat  more  rapid  sequence, 
and  Parts  3,  6,  and  9 adding  some  artillery 
background. 

3.B.5  TESTS  INVOLVING  PSYCHOMOTOR  ABILITY 

3.B.5.1  Patterns  Test  - A combined  perceptual, 
spatial,  and  psychomotor  measure  requiring  the 
examinee  to  reproduce,  by  freehand  drawing  in  the 
lower  portion  of  a machine-scored  answer  sheet,  a 
series  of  line  diagrams  presented  in  the  upper 
portion,  making  sure  that  the  lines  of  the  drawings 
go  through  answer  spaces  in  the  same  way  as  do  the 
master  diagrams. 

{ 

3.B.5.2  Two-Hand  Coordination  Test  - An  eye- 
hand  coordination  test  requiring  the  examinee  to 
place  a stylus  point  in  successive  circles  on  the 
test  sheet,  moving  left  hand  and  right  hand  alter- 
nately, in  three  times  parts  of  25  seconds  each. 
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*p  - .05 

**p  < .01 


APPENDIX  3.C 

COMPARISONS  OF  FIGHTERS  WITH  NONFIGHTERS 
ON  QUESTIONNAIRE  - TYPE  PERSONALITY  TESTS  | 


VARIABLE 


Academic  Achievement 

Delinquency 

Dissimulation 

Dominance 

Femininity 

Flexibility 
Good  Impression 
Graduate  School  Potential 
Honor  Point  Ratio 
Impulsivity 

Infrequency 

Intellectual  Efficiency 
Neurodermititis 
Psychological  Interest 
Responsibility 

Self  Acceptance 
Social  Participation 
Social  Presence  - X-j 
Social  Status 
Tolerance 


Academic  Achievement 
Caudal  ity 
Delinquency 
Dependency 

Depression 
Dominance 
Dissimulation 
Ego  Strength 
-F 

Feminity 

Honor  Point  Ratio 
Hypochondriasis 

Hypomania 

Hysteria 

Intellectual  Efficiency 
X2  Impulsivity  Self-Centeredness 
Graduate  School  Potential 


Leadership 

-L 

Low  Backache 
Masculinity- Femininity 

Neurodermititis 

Originality 

Paranoia 

Parietal  Lobe  Damage 


GROUP  WITH  HIGHER  SCORE 
FIGHTERS  NONFIGHTERS 


P LEVEL  ON  t TESTS 


(N  = 162) 


(N  = 161) 


(N  • 138) 


iThis  is  based  upon  a table  from  Egbert,  Meeland,  Cline,  Forgy,  Spickler,  & Brown  (1957) 
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GROUP  WITH  HIGHER  SCORE 


VARIABLE 

X]  Poise,  Spontaneity 
Psychasthenia 
Psychological  Interest 

Psychopathic  Deviate 
Responsibility 
Role  Playing 
Schizophrenia 

Schizophrenic  Screening  Scale 

Social  Introversion 
Social  Participation 
Social  Status 
Factor  A 
Factor  R 
Tolerance 

HUMOR  TEST 

Factor  1 
Factor  2 
Factor  3 
Factor  4 
Factor  5 

Factor  6 
Factor  7 
Factor  8 
Factor  9 
Factor  10 

16  PERSONALITY  FACTOR  TEST 

Factor  A 
Factor  B 
Factor  C 
Factor  E 
Factor  F 

Factor  G 
Factor  H 
Factor  I 
Factor  L 
Factor  M 

Factor  N 
Factor  0 
Factor  Qi 
Factor  Q2 
Factor  Q3 
Factor  Q4 
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(N  = 138) 


(N  = 137) 
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APPENDIX  3.C  (CONTINUED) 


GROUP  WITH  HIGHER  SCORE 

variable 

FIGHTERS 

NONFIGHTERS 

P LEVEL  ON  t TESTS 

"HIB" 

INVENTORY  P 

(N  = 160) 

(N  • 134) 

Mating 

/ 

Escape-Fear 

/ 

Parenta 1 -Pro tec ti ve 

/ 

AA 

Appeal -Dependence 

/ 

Curiosity 

/ 

A 

Self-Assertion  and  Display 

/ 

Gregariousness 

/ 

A 

Self-Sentiment 

/ 

Narcissistic  Play 

/ 

"MIT" 

(N  = 124) 

(N  * 91) 

/ 

AA 

INVENTORY  OF  PERSONAL  PHILOSOPHY 

(N  = 163) 

(N  > 136) 

Fundamentalist  Belief 

/ 

Fundamentalist  Disbelief 

/ 

Enlightened  Belief 

/ 

Enlightened  Disbelief 

/ 

Complexity  of  Outlook 

/ 

Extraception 

/ 

AA 

Arti sti c-Compl ex-Independence 

/ 

A 

Chromatic 

/ 

S 1 mp1 e-0b1 1 g i ng- Goodhea  rted 

/ 

Liberalism 

/ 

Romanticism 

/ 

Intelligent  Opinion 

/ 

CALIF.  PUBLIC  OPINION  SCALES 

(N  = 162) 

(N  = 135) 

Ethonce 

/ 

Fascism 

/ 

A 

Political -Economic  Conservatism 

/ 

SOCON 

(N  = 147) 

(N  = 124) 

"Self"  Estimate 

/ 

A 

Inferred  "Others"  Estimate 

/ 

JUDGING  PERSONALITY  FILM 

(N  = 163) 

(N  = 135) 

Word  List 

/ 

A 

PERSONAL  CHECK  LIST 

(N  = 162) 

(N  ■ 136) 

/ 

FIGURE  PREFERENCE 


(N  = 165)  (N  =^140) 
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APPENDIX  3.0 

COMPARISONS  OF  FIGHTERS  WITH  NONFIGHTERS 
IN  A CLINICAL  INTERVIEW  * 


ITEM  AND  RATING 
BEHAVIOR  DURING  INTERVIEW 
IDENTIFICATION  WITH  COMBAT  UNIT 
High 

Above  Average 
Below  Average 
Low 

(Not  Rated) 

COGNITIVE  ORGANIZATION 
High 

Above  Average 
Below  Average 
Low 

(Not  Rated) 

BEHAVIOR  IN  INTERVIEW 

Indifferent 

Defensive 

Hostile 

Confused 

Cagey.  Guarded 

Guilt  - Ridden 

Cooperative 

Sarcastic 

Smart-Alecky 

Uncooperative 

Dependent 

Overly  Cooperative 
Conscientious 
Matter-Of-Fact 
Tense  and  Nervous 
Self-Assured,  Poised 
Egotistical,  Boastful 
Reserved,  Dignified 
Infantile,  Immature 
Conventional 
Interes  ted 
Peculiar  Mannerisms 


PERCENT  OF 
FIGHTERS 


PERCENT  OF 
NONFIGHTERS 


P LEVEL  ON  t TESTS 


Neat 
Casual 
Sloppy 
(Not  Rated) 


POSTURE 


Relaxed 

Tense 

Other 

(Not  Rated) 
Odd  Features 


* This  is  based  upon  a table  from  Egbert,  Meeland,  Cline,  Forgy,  Spickler,  t Brown  (1957) 
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ITEM  AND  RATING 

PERCENT  OF 
FIGHTERS 

PERCENT  OF 
NONFIGHTERS 

P LEVEL  ON  t TESTS 

USE  OF  WORDS 

Stumbling 

1 

10 

A* 

Hesitant 

19 

32 

*A 

Average 

43 

38 

Fluent 

28 

11 

A* 

Verbose 

2 

1 

(Not  Rated) 

7 

9 

RATE  OF  OUTPUT 

Slow 

16 

35 

AA 

Medium 

57 

42 

A 

Fast 

21 

16 

Very  Fast 

1 

0 

(Not  Rated) 

7 

8 

. i 

SOCIAL-ECONOMIC  LEVEL 
FAMILY  BACKGROUND 


High  Income  Level 

1 

2 

■ 

Medium  Income  Level 

52 

36 

AA 

7 

Low  Income  Level 

45 

61 

AA 

> 

(Not  Rated) 

1 

1 

^ ; * 

Stable  Income 

32 

19 

A 

1 

Variable  Income 

47 

52 

; 

Erratic  Income 

18 

28 

A 

(Not  Rated) 

3 

2 

INCOME  SOURCE 

Professional  High 
Professional  Low 
Business  High 
Business  Low 
Industrial  High 
Industrial  Low 
Agriculture  High 
Agriculture  Low 
Other 

(Not  Rated) 

BY  FIELD  COMBINING  LEVELS 

Professional 

Business 

Industrial 

Agriculture 

BY  LEVEL  COMBINING  FIELDS 

High 

Low 

QUALITY  OF  RESIDENCE 
High 

Middle  Class 
Low 

(Not  Rated) 


1 


1 

3 

3 

2 

7 

4 

6 

7 

21 

9 

34 

40 

13 

9 

14 

22 

1 

0 

2 

4 

*• 


4 

13 

55 

27 


5 

11 

49 

31 


42  25 

54  71 


A* 


1 

58 

40 

2 


2 

33 

59 

5 


** 

** 
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APPENDIX  3.D  (CONTINUED) 


PERCENT  OF  PERCENT  OF 

ITEM  AND  RATING  FIGHTERS  NONFIGHTERS  P LEVEL  ON  t TESTS 


PREVIOUS  WORK  BEFORE  THE  ARMY 


Farm  Labor 

10 

11 

Menial  Labor 

1 

8 

Unskilled  Labor 

35 

36 

Semiskilled  Work 

32 

28 

Skilled  Trade 
HOME  ENVIRONMENT 

5 

2 

LOCATION  OF  RESIDENCE 

Large  City 

22 

22 

City 

24 

21 

Town 

22 

26 

Rural 

30 

29 

(Not  Rated) 

1 

2 

INTELLECTUAL  CLIMATE 

High 

1 

0 

Medium 

47 

27 

Low 

49 

69 

(Not  Rated) 

3 

4 

THE  FAMILY 

A Complete  Family  Unit  In  A Fairly 
Normal  Home 

68 

52 

Not  A Complete  Family  Unit  In  A 
Fairly  Normal  Home 

31 

47 

(Not  Rated) 

1 

1 

DISTANCE  FAMILY  HAS  MOVED 

Little  Or  None 

47 

48 

Some  Change 

26 

26 

Much  Change 

18 

10 

Complete  Break 

8 

15 

FREQUENCY  OF  FAMILY  MOVES 

Often 

13 

12 

A Few  Times 

20 

24 

Rarely  Or  Never 

67 

62 

(Not  Rated) 
COMMUNITY  ACTIVITIES 

1 

0 

Father's  Participation 

Joiner 

14 

11 

Average 

65 

55 

Isolate 

13 

13 

(Not  Rated) 
Father's  Position 

9 

21 

Leader 

22 

12 

Follower 

26 

28 

(Not  Rated) 

Mother's  Participation 

52 

61 

Joiner 

13 

12 

Average 

71 

64 

Isolate 

14 

15 

(Not  Rated) 

4 

9 

MDC  E1634  • 29  APRIL  1977 


/ 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


AfCOOWMm.  OOUaLM^ 


C<NP^€NVArMMV 


APPENDIX  3.D  (CONTINUED) 


ITEM  AND  RATING 

PERCENT  OF 
FIGHTERS 

PERCENT  OF 
NONFIGHTERS 

P LEVEL  ON  t TESTS 

Mother's  Position 

Leader 

22 

14 

Follower 

23 

31 

(Not  Rated) 

55 

54 

Subject’s  Participation 

Joiner 

17 

/ 

Average 

65 

68 

Isolate 

16 

17 

(Not  Rated) 

2 

7 

Subject's  Position 

Leader 

24 

17 

Follower 

21 

25 

(Not  Rated) 

55 

58 

STRENGTH  OF  FAMILY  XINSHIP  TIES 

High 

40 

20 

** 

Medium 

46 

60 

* 

Low 

14 

16 

(Not  Rated) 

0 

5 

* 

AMOUNT  OF  INTERACTION  BETWEEN  THE  FAMILY 
AND  OTHER  RELATIVES 

High 

41 

28 

* 

Medium 

41 

47 

Low 

18 

21 

(Not  Rated) 

0 

4 

* 

MARITAL  STATUS  OF  PARENTS 

Together 

71 

64 

Separated 

9 

n 

Divorced 

9 

8 

Never  Married 

11 

18 

DEATH  OF  PARENT  WHILE  SUBJECT  GROWING  UP 

Father  Dead 

15 

28 

<** 

Father  Alive 

85 

72 

** 

Mother  Dead 

7 

12 

Mother  Alive 

94 

88 

FATHER-MOTHER  RELATIONSHIP 

Excellent 

22 

18 

Average 

49 

43 

Hostile 

7 

13 

Ambivalent 

8 

9 

(Not  Rated) 

14 

18 

EXPRESSION  OF  FATHER-MOTHER  RELATIONSHIP 

Overt 

55 

58 

Covert 

21 

13 

(Not  Rated) 

24 

29 

3.0-4 
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APPENDIX  3.D  (CONTINUED) 


PERCENT  OF 

PERCENT  OF 

ITEM  AND  TRAINING 

FIGHTERS 

NONFIGHTERS 

P LEVEL  ON  t TESTS 

HEALTH  OF  FATHER 

Chronic  Physical  Illness 

38 

35 

Chronic  Mental  Illness 

1 

1 

Alcoholism 

B 

9 

Short-Term  Illness 

15 

12 

Other  Conditions 

3 

1 

HEALTH  OF  MOTHER 


Chronic  Physical  Illness 

35 

38 

Chronic  Mental  Illness 

1 

2 

Alcoholism 

2 

2 

Short-Term  Illness 

11 

13 

Other  Conditions 

2 

2 

SUBJECT-FATHER  AFFECT 
INTENSITY 

High 

30 

16 

* 

Medium 

51 

53 

Low 

11 

16 

(Not  Rated) 

9 

16 

FATHER  SEEN  AS 
Easy  Going 

43 

39 

Introverted 

9 

9 

Strict 

19 

22 

Nervous 

9 

3 

* 

Disinterested 

7 

10 

Strong 

31 

20 

* 

Demanding 

8 

9 

Short-Tempered 

22 

22 

Neurotic 

7 

5 

Vain 

3 

0 

MOTHER  SEEN  AS 

Warm 

59 

47 

* 

Domineering 

2 

7 

* 

Neurotic 

11 

9 

Overprotective 

10 

16 

Suspicious 

1 

4 

Confident 

11 

9 

Anxious 

42 

32 

Patient 

34 

27 

Understanding 

41 

36 

Cruel 

0 

2 

NUMBER  OF  OLDER  MALE  SIBLINGS 

None 

26 

23 

1 

23 

23 

2 

IB 

15 

3 

10 

9 

4 

4 

5 

5-9 

4 

2 

(Not  Rated) 

15 

22 
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APPENDIX  3.D  (CONTINUED) 


ITEM  AND  RATING 

PERCENT  OF 
FIGHTERS 

PERCENT  OF 
NONFIGHTERS 

P LEVEL  ON  t TESTS 

NUMBER  OF  OLDER  FEMALE  SIBLINGS 

None 

22 

26 

1 

26 

20 

2 

16 

14 

3 

9 

9 

4 

4 

6 

5-9 

5 

6 

(Not  Rated) 

18 

20 

NUMBER  OF  YOUNGER  MALE  SIBLINGS 

None 

25 

21 

1 

29 

30 

2 

18 

16 

3 

4 

5 

4 

1 

2 

5-9 

2 

3 

(Not  Rated) 

21 

22 

NUMBER  OF  YOUNGER  FEMALE  SIBLINGS 

None 

21 

28 

1 

39 

25 

* 

2 

13 

16 

3 

8 

6 

4 

3 

3 

5-9 

0 

1 

(Not  Rated) 

18 

21 

FATHER  SEEN  AS 

Successful  Respected 

55 

47 

Essentially  Mediocre 

33 

29 

Unsuccessful  or  Disgraced 

5 

5 

(Not  Rated) 

7 

22 

** 

Forceful  Personality 

33 

29 

Average  Personality 

48 

43 

I nef fectual  Personal  1 ty 

9 

9 

(Not  Rated) 

10 

17 

MOTHER  SEEN  AS 

Efficient  Homemaker 

69 

47 

** 

Average  Homemaker 

25 

43 

** 

Inefficient  Homemaker 

2 

3 

(Not  Rated) 

4 

6 

Forceful  Personality 

24 

23 

\ 

Average  Personality 

63 

60 

' 

Ineffectual  Personality 

8 

10 

(Not  Rated) 

5 

7 

PUNISHMENT  SUBJECT  RECEIVED 
Amount 

High 

9 

22 

Medium 

66 

56 

Low 

22 

19 

(Not  Rated) 

2 

3 
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APPENDIX  3.D  (CONTINUED) 

PERCENT  OF  PERCENT  OF 

ITEM  AND  RATING  FIGHTERS  NONFIGHTERS 

n/ 

I 

'J 

\ 

P LEVEL  ON  t TESTS 

Consistency 

J 1:^ 

Consistent 

59 

48 

Average 

32 

36 

Erractlc 

7 

11 

(Not  Rated) 

3 

4 

Kind 

Physical 

72 

72 

Confinement 

21 

22 

Verbal 

39 

25 

* 

Deprivation 

20 

19 

Source 

Father 

38 

26 

* 

Mother 

28 

40 

* 

Both 

27 

26 

Other 

5 

5 

(Not  Rated) 

3 

2 

Reasonableness 

Reasonable 

51 

46 

Average 

45 

44 

Irrational 

3 

5 

(Not  Rated) 

3 

5 

THE  SINGLE  MOST  IMPORTANT  SOURCE  OF 

j SEX  EDUCATION 

f 

Father 

7 

2 

* f 

Mother 

3 

2 

1 

Teacher 

1 

1 

f 

Peers 

23 

22 

j 

Literature 

2 

3 

Personal  Experience 

19 

23 

Other 

2 

2 

(Not  Rated) 

43 

45 

j 

SOURCE  OF  SEX  EDUCATION 

1: 

*■  ' Father 

24 

10 

**  1 

. , Mother 

16 

5 

**  1 

» •/!  Teacher 

9 

4 

1 

t ' Peers 

64 

75 

1 

fr  , Literature 

12 

11 

1 

• Personal 

36 

39 

I 

^ 1 Other 

6 

4 

1 

•i 

■ v'l 

FIGHTERS 

NON FIGHTERS 

P LEVEL  ON  t TESTS  | 

, Subject's  age  in  years  at  time  of  separa-  N = 28 

26 

tion  or  divorce  of  parents 

M = 10.0 

7-7 

Age  In  years  at  time  of  father's 

death  N ° 24 

40 

M = 11.8 

10.3 

Age  In  years  at  time  of  mother's 

death  N ° 11 

18 

M = 12.1 

10.2 

Number  of  siblings  subject  has 

N = 160 

138 

1 

M = 4.6 

4.7 

. 1 
> 
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APPENDIX  3.D  (CONTINUED) 


ITEM  AND  RATINGS 

PERCENT  OF 
FIGHTERS 

PERCENT  OF 
NONFIGHTERS 

P LEVEL  ON  t TESTS 

RELIGION 

RELIGIOUS  AFFILIATION 
Subject's 

Protestant-Established 

47 

57 

Protestant-Splinter 

11 

13 

Catholic 

32 

20 

A 

Jewish 

0 

2 

None 

7 

5 

Other 

3 

1 

(Not  Rated) 

1 

2 

Father's 

Protestant-Established 

44 

53 

Protestant-Splinter 

9 

11 

** 

Catholic 

32 

17 

Jewish 

0 

2 

None 

9 

4 

Other 

1 

1 

(Not  Rated) 

5 

12 

* 

Mother's 

Protestant-Establ ished 

51 

58 

Protestant-Spl inter 

10 

14 

Cathol ic 

35 

20 

Jewish 

0 

3 

None 

4 

1 

Other 

0 

1 

(Not  rated) 

5 

4 

DOER  SYNDROME 
PARTICIPATION  IN  SPORTS 

High 

40 

28 

* 

Medium 

3B 

47 

Low 

21 

22 

(Not  Rated) 

1 

3 

TYPE  OF  SPORTS  MOST  PREFERRED 

Body  Contact 

46 

32 

* 

Other 

36 

45 

(Not  Rated) 

18 

23 

PREVIOUS  WORK  BEFORE  THE  ARMY 

Clerical 

4 

11 

* 

Managerial 

1 

2 

Owned  A Business 

2 

0 

Owned  A Farm 

1 

2 

Student  In  College 

2 

0 

No  Job  Before  Artny 

6 

2 

(Not  Rated) 

1 

0 
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PERCENT  OF 

PERCENT  OF 

ITEM  AND  RATING 

FIGHTERS 

NONFIGHTERS 

P LEVEL  ON  t TESTS 

FUTURE  OCCUPATIONAL  GOAL 

Farm  Labor 

0 

1 

Menial  Labor 

1 

1 

Unskilled  Labor 

7 

5 

Semiskilled  Work 

16 

20 

Skilled  Trade 

12 

12 

Clerical  Work 

1 

6 

♦ 

Managerial 

1 

0 

1 

Owned  A Business 

13 

10 

Owned  A Farm 

15 

10 

"My  Old  Job" 

8 

9 

School,  Then? 

3 

6 

Professional 

7 

4 

Stay  In  Military 

9 

5 

No  Plans 

7 

12 

(Not  Rated) 

1 

0 

HEALTH  AND  VITALITY 

PHYSICAL  CONDITION 

■ 

Excellent 

45 

32 

* 

Medium 

48 

50 

Poor 

8 

16 

* 

(Not  Rated) 

1 

0 

, 

PARTICIPATION  IN  SPORTS 

. 

High 

40 

28 

* 

Medium 

38 

47 

Low 

21 

22 

(Not  rated) 

1 

3 

TYPE  OF  SPORTS  MOST  PREFERRED 

Body  Contact 

46 

32 

* 

Other 

36 

45 

(Not  Rated) 

18 

23 

HEALTH  WHILE  GROWING  UP 

Excellent 

63 

53 

Medium 

30 

38 

Poor 

3 

5 

1 

(Not  Rated) 

3 

3 

1 

Usual  Childhood  Illnesses 

51 

55 

1 

..  A Single  Serious  Illness 

22 

20 

1 

A Chronic  Illness 

7 

6 

1 

VITALITY 

1 

High 

41 

21 

a 

Medi urn 

53 

69 

**  H 

Low 

5 

9 

i 

(Not  Rated) 

1 

2 

1 

> 
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APPENDIX  3.D  (CONTINUED) 


ITEM  AND  RATING 

SOCIAL  AND  EDUCATIONAL  HISTORY 
SUBJECT'S  BEHAVIOR  IN  SCHOOL 


High  I 

Average  > 
Low  ) 

(Not  Rated) 


Grade  In  School 


INVOLVEMENT  IN  SCHOOL 

High 

Medium 

Low 

(Not  Rated) 

SOCIAL  TONE  IN  SCHOOL 

Positive 
Average 
Negative 
(Not  Rated) 

SOCIAL  PROFICIENCY  IN  SCHOOL 

High 

Medium 

Low 

(Not  Rated) 

SOCIAL  CONFORMITY  IN  SCHOOL 

High 

Medium 

Low 

(Not  Rated) 

PARENTAL  EXPECTATIONS  AS  TO  GRADES 
IN  SCHOOL 

Much 
Medium 
Little 
(Not  Rated) 

PARENTAL  EXPECTATIONS  AS  TO  ULTIMATE 
LEVEL  OF  ACHIEVEMENT 

Much 
Medium 
Little 
(Not  Rated) 

AGE  OF  CHILDHOOD  ASSOCIATES 

Younger 

Contemporary 

Older 

Adult 

(Not  Rated) 
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APPENDIX  3.D  (CONTINUED) 


ITEM  AND  RATING 

PERCENT  OF 
FIGHTERS 

PERCENT  OF 
NONFIGHTERS 

P LEVEL  ON  t TESTS 

QUALITY  OF  CHILDHOOD  ASSOCIATES 

High 

5 

2 

Average 

73 

80 

Delinquent 

22 

15 

(Not  Rated) 

1 

3 

SIZE  OF  "GANG" 

Large  Group 

25 

23 

Small  Group 

57 

47 

Individual 

16 

22 

Isolate 

2 

5 

(Not  Rated) 

0 

2 

POSITION  OF  SUBJECT  IN  HIS  "GANG" 

Leader 

19 

14 

Variable 

67 

65 

Follower 

9 

15 

(Not  Rated) 

5 

6 

MARITAL  STATUS  OF  SUBJECT 

Married 

25 

26 

Single 

71 

71 

Separated 

2 

2 

Widower 

0 

0 

Divorced 

1 

2 

NUMBER  OF  CHILDREN  SUBJECT  HAS 

None 

9 

5 

1 

11 

9 

2 

2 

2 

3 

1 

2 

4 

0 

1 

Not  Married 

78 

81 

WHEN  AND  HOW  MARRIED 

Church 

17 

15 

Civil  Ceremonies 

11 

10 

At  Home 

1 

3 

Not  Married 

71 

72 

ATTITUDE  TOWARD  PREGNANCY  AND  CHILDREN 

Positive 

20 

16 

7 

4 

5 

Negative 

1 

4 

- 

75 

74 

MARITAL  ADJUSTMENT 

Very  Good 

17 

13 

O.K. 

6 

7 

Not  So  Good 

1 

2 

Poor 

5 

2 

(Not  Rated) 

71 

75 
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APPENDIX  3.D  (CONTINUED) 


PERCENT  OF 


ITEM  AND  RATING  FIGHTERS 


CROSS-CULTURAL  MARRIAGES 

Yes  1 
No  28 
(Not  Rated)  72 

CROSS-RELIGIOUS  MARRIAGE 

Yes  5 
No  23 
(Not  Rated)  72 

LIFE  INFLUENCES 

Miscellaneous  6 
The  Army,  Positive  or  Neutral  Mention  16 
The  Amiy,  Negative  Mention  5 
Commitment  to  a Relationship  with  a 6 
Woman 

Termination  of  a Relationship  with  a 5 
Woman 

Unpleasant  Experiences,  General  7 
Parental  Guidance  7 
The  Combat  Experience  3 
An  Ego  Ideal  Other  Than  Parents  5 
Becoming  Independent  Before  The  Army  5 
Don't  Know,  Can't  Say  3 
(Not  Rated)  32 


PERCENT  OF 

NONFIGHTERS  P LEVEL  ON  t TESTS 


2 

26 

72 


5 

23 

72 


7 

12 

5 

5 

3 

5 

11 

2 

2 

3 

5 

40 


FIGHTERS  NONFIGHTERS  P LEVEL  ON  t TESTS 


Age  in  years  at  time  of  first  sex 

N 

= 

81 

59 

experience 

M 

a 

15.8 

14.3 

Subject's  age  in  years  at  time  of 

N 

a 

48 

40 

marriage 

M 

* 

19.7 

20.6 

Wife's  age  in  years  at  time  of 

N 

= 

47 

40 

marraige 

M 

= 

18.3 

18.7 

Time  in  months  that  wife  was  known 

N 

47 

40 

before  marriage 

M 

= 

27.0 

35.9 

Length  of  engagement  in  months 

N 

s 

46 

37 

M 

= 

7.9 

8.1 

Interval  in  months  between  marriage 

N 

= 

23 

18 

and  wife's  pregnancy 

M 

= 

9.2 

6.3 
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APPENDIX  5. A 

PRELIMINARY  STATISTICAL  ANALYSIS  FOR  THE 
DEVELOPMENT  OF  THE  PILOT  LIFE  INVENTORY 
QUESTIONNAIRE  (SHORT  FORM) 

In  a preliminary  effort  to  refine  the  original 
141  item  Life  Experience  Inventory,  this  device  was 
administered  to  a small  (n  ■ 39)  sample  of  Navy 
pilots  who  were  students  or  instructors  at  the 
Navy's  Air  Combat  Maneuvering  Range.  Five  grades 
were  available  for  25  of  the  28  students  in  this 
sample.  These  included  each  of  the  five  topics 
specified  below; 

a.  The  tactics  syllabus  grade  is  an  average 
of  IP  evaluations  on  8 + 2 sorties 
against  a variety  of  surrogate  opponents. 

The  components  of  the  tactics  syllabus 
includes  aggressiveness,  airmanship, 
headwork,  and  tactical  maneuvering. 

These  are  also  separately  rated. 

b.  The  aggressiveness  rating  is  based  on  how 
well  the  student  stays  on  the  attack. 

c.  Airmanship  is  a general  category  dealing 
with  the  basic  way  of  handling  the  air- 
plane. This  includes  smooth  maneuvering, 
accurate  maintenance  of  headings,  etc. 

d.  The  headwork  rating  assesses  the  man's 
ability  to  "think  on  his  feet."  For  exam- 
ple, did  the  student  reach  logical  con- 
clusions about  tactics,  fuel  usage,  and 
weather. 

e.  The  tactical  maneuvering  grade  is  based 
upon  the  ability  to  select  and  appropri- 
ately use  various  standard  maneuvers 
against  the  surrogate  opponents. 

The  final  overall  grade  is  based  upon  instru- 
ment, bombing,  tactics,  radar,  and  carrier  gualifi- 
cation  grades.  The  training  syllabus  upon  which 
that  grade  is  based  includes  about  110  hours  in 
the  plane.  A seventh  criterion  dimension,  years 
flying  experience,  was  available  for  all  28  students. 
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Since  the  range  of  scores  assigned  on  a four 
point  scale  was  very  limited  (e.g.,  2.21  to  3.30 
for  headwork;  2.93  to  3.26  for  the  final  overall 
grade),  the  students  were  rank  ordered  on  each  of 
the  six  grade  scales.  Grades  in  the  upper  and 
lower  thirds  (slight  adjustments  for  tied  scores) 
of  each  distribution  were  selected  for  analysis. 

The  rank  ordered  raw  scores  appear  in  Figure  5.A-1. 
Correlations  between  guestionnaire  responses  and 
each  of  the  sic  grade  criteria  (rank  ordered  raw 
scores)  were  computed.  These  correlations  (phi 
coefficients)  appear  in  Figure  5.A-2.'  Also  present 
in  Figure  5.A-2  are  correlations  (phi  coefficients) 
between  questionnaire  responses  and  four  criteria 
of  instructor  versus  student  group  membership. 

These  criteria  were,  (1)  Instructors  versus  the 
total  set  of  students;  (2)  instructors  versus  all 
students  except  two  who  had  unusual  flying  experi- 
ences which  made  them  a typical  (i.e.,  a former 
British  Empire  Test  Pilot  School  Instructor,  and  a 
U.S.  test  pilot  who  had  flown  E2s  for  some  time); 

(3)  Instructors  versus  the  eight  highest  scoring 
students  on  the  final  overall  grade;  and  (4) 
instructors  versus  the  eight  lowest  scoring 
students  on  the  final  overall  grade. 

The  39  pilots  completing  the  Life  Experience 
Inventory  formed  a rather  homogeneous  group  as  all 
of  them,  even  the  students,  were  rated  fighter 
pilots.  Even  so,  some  items  distinguished  between 
the  various  groups.  Check  marks  in  Figure  5.A-2 
indicate  those  items  with  phi  values  which  seem  to 
be  statistically  significant. 


'Since  deletion  of  the  middle  third  of  the 
distribution  inflates  the  correlation  coefficient, 
results  obtained  are  only  suggestive. 
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TACTICS 


TACTICAL 


OVERALL  GRADE  SYLLABUS  GRADE  AGGRESSIVENESS  AIRMANSHIP HEADWORK  MANEUVERING 


PILOT 

NO. 

VALUE 

PILOT 

NO. 

VALUE 

PILOT 

NO. 

VALUE 

PILOT 

NO. 

VALUE 

PILOT 

NO. 

VALUE 

PILOT 

NO. 

VALUE 

4 

3.26 

183 

3.28 

28 

3.50 

3 

18 

3.45 

183 

3.30 

21 

3.27 

22 

3.20 

4 

3.22 

8 

3.39 

17 

3.32 

11 

3.11 

183 

3.25 

11 

3.15 

11 

3.19 

6 

3.38 

28 

3.32 

7 

3.11 

11 

3.25 

28 

3.13 

28 

3.18 

22 

3.36 

4 

3.30 

10 

3.10 

16 

3.18 

18^ 

3.12 

21 

3.16 

21 

3.35 

22 

3.30 

17 

3.09 

6 

3.16 

10 

3.11 

8 

3.15 

9 

3.32 

11 

3.23 

27 

3.06 

8 

3.15 

6 

3.10 

22 

3.15 

11 

3.32 

8 

3.21 

20 

3.05 

23 

3.15 

17 

3.09 

6 

3.14 

7 

3.30 

26 

3.19 

16 

3.04 

22 

3.14 

9 

3.08 

16 

3.14 

19“ 

3.25 

9 

3.18 

6 

3.03 

15 

3.13 

26 

3.08 

26 

3.14 

24 

3.23 

16 

3.18 

19“ 

3.02 

17 

3.10 

21 

3.07 

23 

3.15 

16 

3.22 

6 

3.16 

29 

3.02 

28 

3.10 

27 

3.07 

17 

3.12 

183 

3.20 

20 

3.16 

21 

3.00 

10 

3.08 

16 

3.05 

9 

3.10 

17 

3.18 

7 

3.15 

4 

3.00 

7 

3.05 

23 

3.05 

2* 

3.08 

23 

3.18 

10 

3.14 

9 

3.00 

9 

3.03 

15 

3.03 

7 

3.08 

26 

3.17 

21 

3.12 

15 

3.00 

12 

3.03 

7 

3.02 

10 

3.07 

12 

3.15 

2 

3.08 

21 

3.00 

27 

3.03 

24 

3.02 

15 

3.07 

10 

3.13 

24 

3.08 

24 

3.00 

20 

2.98 

12 

3.01 

20 

3.07 

52 

3.12 

23 

3.06 

26 

3.00 

4 

2.95 

20 

3.01 

27 

3.07 

15 

3.12 

27 

3.06 

28 

3.00 

12 

2.94 

V 

3.00 

12 

3.02 

20 

3.10 

19“ 

3.05 

23 

2.93 

24 

2.88 

29 

2.97 

13 

3.02 

4 

3.09 

15 

3.04 

13 

2.92 

29 

2.85 

52 

2.95 

19“ 

2.99 

27 

3.08 

12 

3.00 

22 

2.91 

26. 

2.84 

19“ 

2.93 

24 

2.94 

29 

3.07 

13 

3.00 

12 

2.90 

21 

2.81 

5 

2.93 

13 

3.01 

29 

3.00 

52 

2.84 

52 

2.80 

29 

2.80 

21 

3.00 

52 

2.96 

8 

2.21 

19“ 

2.58 

J: 

I 


*USAF  Test  Pilot  School  Graduate,  flew  E2's  8 years. 
^Much  difficulty  in  F4  tactics  traits  training. 

^British  Empire  Test  Pilot  School  Instructor. 

'*Flew  OV  ID'S  5 years. 

^Former  VF  121  Tactics  Instructors,  MIG  21  kill  in  SEA. 


FIGURE  5.A-1  NAVY  STUDENT  PILOTS  RANK 
ORDERED  ON  SIX  CRITERION  DIMENSIONS 
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FIGURE  5.A-2  (Continued) 


All  Pilots'  Worst  Overall  Best  Overall  Tactical  Tactics 

All  Pilots*  Except  2 A 18  vs  Instructors  vs  Instructors  Overall  Score  Aggressiveness  Hea(»«ork  Maneuvering AirwansKip  Syllabus  Graces 
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APPENDIX  5.B 

PILOT  LIFE  INVENTORY  QUESTIONNAIRE 
(Short  Form) 

Section  1 

1)  Before  you  entered  the  Armed  Forces,  in  what 
type  of  house  did  you  and  your  wife  (you  and 
your  parents,  or  you  alone)  live? 

1.  A private,  one  family  house  which  we  owned. 

2.  A private,  one  family  house  which  we  rented. 

3.  An  apartment  in  a residential  apartment 
house. 

4.  A condominium  which  we  owned. 

2)  How  often  do  you  seek  advice  and  aid  from  other 
peopl e? 

1 . Very  often 

2.  Often 

3.  Once  in  a while 

4.  Rarely 

5.  Never 

3)  How  frequently  has  the  thought  entered  your 
mind  that  other  people  dislike  you  or  something 
about  you? 

1 . Very  often 

2.  Often 

3.  Once  in  a while 

4.  Never 

4)  In  general,  divorce  settlements  are  too  favor- 
able to  the  woman. 

1.  Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

5)  I like  to  tell  other  people  what  I think  of 
them. 

1.  Very  much 

2.  Somewhat 

3.  Very  little 

4.  Not  at  all 

6)  Sometimes  in  combat  your  own  command  and  con- 
trol can  be  yo'ir  worst  enemy. 

1 . Strongly  agree 

2 . Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

7)  1 like  to  be  asked  to  settle  disputes  between 
others. 


1. 

Very  much 

2. 

Somewhat 

3. 

Very  little 

4. 

Not  at  all 

8)  How  often  do  you  make  use  of  credit  or  loans 
of  over  3D  days? 

1 . Never 

2.  Rarely 

3.  Once  in  a while 

4.  Fairly  often 

5.  Often 

9)  I like  to  do  things  my  own  way,  regardless  of 
criticism  or  convention. 

1 . Very  much 

2.  Somewhat 

3.  Very  little 

4.  Not  at  all 

10)  How  difficult  for  you  were  changes  from  one 
school  or  college  to  another? 

1.  Difficult  and  disagreeable 

2.  Somewhat  difficult  and  disagreeable 

3.  Easily  enough  made 

4.  Fun 

5.  I did  not  make  these  kinds  of  changes 

11)  It  is  very  important  to  be  successful  in  things 
you  try  to  do. 

1 . Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

12)  As  a boy,  how  frequently  did  you  take  a dare? 

1.  Almost  always 

2.  Usually 

3.  Sometimes  and  sometimes  not 

4.  Almost  never 

5.  Never 

13)  The  difference  between  the  combat  effective 
pilot  with  no  kills  and  a few  kills  is  often  a 
matter  of  luck. 

1 . Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

14)  Mastering  the  flying  techniques  was  the  easier 
part  of  the  training  program. 

1 . Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

15)  How  frequently  do  you  borrow  money  from  personal 
friends? 

1 . Very  often 

2.  Fairly  often 

3.  Once  in  a while 

4.  Rarely 

5.  Never 
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16)  Before  you  were  married  when  you  dated  one 
girl  fairly  regularly,  did  you  date  other 


23)  A man's  devotion  to  flying  must  be  tempered  by 
his  devotion  to  his  family. 


girls  at  the  same  time? 

1.  Very  often 

2.  Often 

3.  Once  in  a while 

4.  Rarely 

5.  Never 

17)  It  bothers  me  to  lose  a game. 

1.  Very  much 

2.  Somewhat 

3.  Very  little 

4.  Not  at  all 

18)  Responsibility  for  birth  control  rests  with 
the  woman. 

1.  Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

19)  Sports  like  auto  racing  are  not  too  dangerous 
if  you  have  the  skill . 

1 . Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

20)  Flying  with  your  head  is  as  important  as 
flying  with  your  hands,  e.g.,  having  the 
coordination  skills  needed  to  fly  well. 

1.  Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

21)  A fighter  pilot  will  live  or  die  on  the  basis 
of  his  own  competence. 

1.  Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

22)  During  actual  combat  a good  pilot  is  likely 
to  be: 

1.  Calm  throughout  the  combat 

2.  Somewhat  nervous  before  and  calm  during 
combat 

3.  Tense  and  alert  at  all  times 

4.  Apprehensive  but  doing  his  best  despite  it 


1 . Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

24)  After  a serious  fight  or  argument  I: 

1.  Calm  down  quickly 

2.  Feel  weak  and  shaky 

3.  Do  not  think  about  the  incident  much 

4.  Have  difficulty  falling  asleep 

5.  Keep  going  over  in  my  mind  what  I should 
have  done  or  said 

25)  When  involved  in  making  group  decisions,  the 
group  will  usually  agree  with  my  opinion. 

1 . Very  often 

2.  Often 

3.  Once  in  a while 

4.  Rarely 

5.  Never 

26)  In  sports  or  games,  when  you  have  a compelling 
lead  over  your  opponent  do  you  tend  to  ease  up? 

1 . Very  often 

2.  Fairly  often 

3.  Once  in  a while 

4.  Rarely 

5.  Never 

27)  As  a boy,  how  were  your  finances  taken  care  of? 

1.  An  allowance 

2.  My  family  giving  me  what  I needed  when  I 
asked  for  it 

3.  Generally  getting  along  without  cash 

4.  Earning  my  own  money  for  some  of  the 
things  I wanted  ' 

5.  Earning  my  own  money 

6.  Getting  allowance  for  doing  specific  family 
chores 

28)  What  was  the  regular  work  of  your  father?  (If 
the  income  of  your  family  came  chiefly  from 
someone  other  than  your  father,  show  the  regu- 
lar kind  of  work  of  that  person. ) 

1.  Professional  - such  as  architect,  artist, 
musician,  author,  chemist,  teacher,  pro- 
fessor, doctor,  dentist,  lawyer,  military 
officer,  etc. 

2.  Proprietor,  Manage'",  or  Official  - such  as 
a store  owner,  wholesale  dealer,  manufac- 
turer, farm  owner,  builder,  company  offi- 
cial, banker,  government  official  or 
inspector,  etc. 


/ 


PREDICTING  PILOT  AIR  COMBAT  EFFECTIVENESS 


MCOOMMKLL  OOUGLJ*» 


eom9K>mMT$om 


43)  I like  to  participate  in  a number  of  activities, 
whether  or  not  I do  particularly  well. 

1 . Very  often 

2.  Often 

3.  Once  in  a while 

4.  Rarely 

5.  Never 

44)  There  is  a large  difference  between  taking  cal-  ■ 
culated  risks  and  taking  chances. 

1 . Strongly  agree 

2 . Agree 

3.  No  opinion 

4.  Disagree  j 

5.  Strongly  disagree 

45)  It  is  often  better  to  give  in  and  avoid  a fight 
than  to  try  to  have  things  your  own  way. 

1 . Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

46)  I like  to  supervise  or  direct  the  actions  of 
others. 

1 . Very  much 

2.  Somewhat 

3.  Very  little 

4.  Not  at  all 


SECTION  2 

For  the  following  group  of  questions,  mark  as  many 
responses  as  apply. 

47)  If  blocked  from  pilot  training  for  minor 
physical  reasons,  such  as  20/25  vision,  color 
vision  weakness,  height  or  weight,  I would: 

1.  Accept  the  decision 

2.  Try  to  correct  the  defect  in  an  acceptable 
fashion 

3.  Memorize  the  eye  chart  or  otherwise  fudge 
the  results 

4.  Seek  a waiver 

5.  Use  influence  to  get  an  exception  made 

48)  In  which  of  the  following  activities  have  you  an 
and  your  family,  or  members  of  the  group  with 
which  you  lived,  engaged  fairly  often? 

1.  Made  such  things  as  toys,  play  equipment, 
gifts,  furniture  together 

2.  Listened  to  music  together 

3.  Attended  social  gatherings 

4.  Talked  about  our  day's  activities  together 

5.  Went  on  trips  together 

6.  Engaged  in  sports  together 


49)  Which  of  the  following  things  do  you  remember 
doing  as  a child? 

1.  Having  nightmares 

2.  Being  timid  away  from  home 

3.  Fighting 

4.  Crying 

5.  Doing  cruel  things 

6.  Snitching  things 

7.  Playing  hookey 

8.  Biting  fingernails 

9.  Telling  lies  to  avoid  punishment 

10.  Running  away  from  home 

1 1 . None  of  these 

50)  Which  of  the  following  activities  have  you 
engaged  in  fairly  often? 


1. 

Football 

19. 

Gymnastics 

2. 

Baseball 

20. 

Spelunking 

3. 

Softball 

21. 

Sky  diving 

4. 

Swimming 

22. 

Motocross 

5. 

Hockey 

23. 

Dirt  biking 

6. 

Roller  Skating 

24. 

Handball 

7. 

Ice  skating 

25. 

Racquet  ball 

8. 

Boxi ng 

26. 

Scuba  diving 

9. 

Wrestling 

27. 

Auto  racing 

10. 

Basketball 

28. 

Weight  lifting 

11. 

Soccer 

29. 

Surfing 

12. 

Track 

30. 

Cal isthenics 

13. 

Skiing 

31. 

Horseback  riding 

14. 

Sailboating 

32. 

Water  skiing 

15. 

Canoeing 

33. 

Hang  gliding 

16. 

Skeet  shooting 

34. 

Soaring 

17. 

Marksmanship 

35. 

Diving 

18. 

Tennis 

51)  Why  did  you  get  interested  in  being  a fighter 

pilot? 

1.  My  father  was  a fighter  pilot 

2.  There  were  openings  when  I finished  under- 
traduate  pilot  training 

3.  I first  got  interested  in  ROTC 

4.  I got  interested  through  movies  and  books 

5.  I had  a long  time  interest  in  aviation  and 
space  flight 

6.  Other 

52)  If  I had  been  blocked  from  entry  into  under- 
graduate pilot  training  for  administrative 

reasons,  I would  have: 

1.  Accepted  an  alternative  service  school 

2.  Appealed  the  decision  to  appropriate 
authorities 

3.  Tried  to  use  influence  of  senior  military 
officers  or  a congressman 

4.  Accepted  alternate  duty  and  continued  to 
reapply 
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28)  (Continued) 

3.  Clerical  or  Sales  Worker  - such  as  work  In 
a store  or  office,  agent,  salesman,  book- 
keeper, stenographer,  technical  assistant, 
etc. 

4.  Skilled  Worker  or  Foreman  - such  as  mason, 
carpenter,  electrician,  mechanic,  tailor, 
conductor,  baker,  foreman  in  factory,  farm 
or  mine,  military  enlisted  man,  etc. 

5.  Semiskilled  Worker  - such  as  apprentice, 
factory  operative,  sailor,  chauffeur, 
delivery  man,  attendant,  etc. 

6.  Unskilled  Worker  - such  as  laborer  in 
factory,  farm,  or  construction,  fisherman, 
longshoreman,  elevator  man,  etc. 

29)  How  far  did  your  father  (or  stepfather  or  fos- 
ter father)  go  in  school? 

1.  Grade  school  (8th  grade  or  less) 

2.  Some  high  school 

3.  Graduated  from  high  school 

4.  Some  training  after  high  school  but  not 
college 

5.  Some  college 

6.  Graduated  from  college 

7.  Advanced  training  after  college  graduation 

30)  Have  you  found  yourself  in  a situation  where 

you  jijrt  didn't  know  what  to  do? 

1.  Very  often 

2.  Often 

3.  Once  in  a while 

4.  Rarely 

5.  Never 


35)  How  many  fights  did  you  have  from  age  18  or 
older? 

1.  0 

2.  1 or  2 

3.  3 to  5 

4.  5 to  10 

5.  More  than  10 

36)  The  population  of  the  town  I grew  up  in  was: 

1.  Under  1000 

2.  1000-5000 

3.  5000-25,000 

4.  25,000-100,000 

5.  100,000-500,000 

6.  Over  500,000 

37)  How  old  were  you  when  you  had  your  first  regu- 
lar paid  job,  part-time  or  full  time? 

1 . 12  years  or  less 

2.  13  to  15 

3.  16  to  18 

4.  19  or  older 

38)  When  did  you  first  get  interested  in  being  a 
fighter  pilot? 

1.  In  grade  school 

2.  In  high  school 

3.  In  college 

4.  In  undergraduate  pilot  training 

39)  To  get  into  the  fighter  pilot  program  it  is 
excusable  to  conceal  potential  major  physical 
disabilities  such  as  diabetes  or  aheartmurmur 


31)  While  you  were  growing  up,  to  what  extent  was 
the  attitude  that  you  should  always  take 
responsibility  for  your  actions  taught. 

1.  Very  great 

2.  Great 

3.  Not  too  great 

4.  Fairly  small 

5.  Not  at  all 

6.  I cannot  say 

32)  At  what  age  did  you  first  drink  whiskey. 

1.  12  or  younger 

2.  13  to  14 

3.  15  to  16 

4.  17  to  18 

5.  19  to  20 

6.  21  or  over 

33)  As  a child  (under  12)  I: 

1.  Had  few  or  no  fights 

2.  Had  several  fights 

3.  Fought  frequently 

34)  As  a youth  (12  to  17)  I: 

1.  Had  few  or  no  fights 

2.  Had  several  fights 

3.  Fought  frequently 
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1.  Strongly  agree 

2.  Agree 

3.  No  opinion 

4.  Disagree 

5.  Strongly  disagree 

40)  In  fights  that  you  have  been  in,  were  your 
opponents: 

1.  From  the  same  neighborhood 

2.  From  across  town 

3.  From  another  town 

4.  This  does  not  apply  since  I never  fought 

41)  Have  you  been  ejected  from  the  Officer's  Club? 

1 . Several  times 

2.  A few  times 

3.  Once  or  twice 

4.  Never 

42)  As  an  adolescent  did  you  ever  get  in  trouble 
for  drinking? 

1.  Very  often 

2 . Often 

3.  Once  in  a while 

4.  Rarely 

5.  Never 
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53)  Which  of  the  following  things  have  you  had  to 

i plan  for  carefully  and  which  you  have  succeeded 

in  your  goals? 

1.  Being  elected  to  office 

2.  Being  invited  to  join  a fraternity  or  club 

3.  Obtaining  an  introduction  to  someone  I 
wanted  to  meet 

4.  Succeeding  in  a school  subject  that  was 
difficult  for  me 

5.  Getting  ahead  of  someone  with  whom  I was 
competi ng 

6.  Making  a favorable  impression  upon  someone 

7.  Dating  a particular  girl 

8.  Getting  into  the  fighter  pilot  program 

54)  Which  of  the  following  things  have  you  trained 
and  taught  yourself  to  do  well? 

1.  Manual  skills  like  woodworking,  auto 
mechanics,  etc. 

2.  Artistic  skills  like  writing,  sketching, 
painting,  acting,  etc. 

3.  To  speak  well  in  public 

4.  Typing,  shorthand,  etc. 

5.  To  overcome  physical  handicap 

6.  To  acquire  special  ability  to  make  a team 

7.  To  become  less  shy  in  social  relations 

8.  To  control  my  temper 

9.  To  adapt  my  personality  to  the  requirements 
of  any  situation 

55)  Which  of  the  following  describe  you  when  you 
were  in  high  school? 

1.  A varsity  athlete 

2.  Class  officer 

3.  In  the  top  1/3  of  my  class 

4.  A member  of  several  clubs 

5.  A leader  (officer)  in  some  school  club 
or  organization 

■ 6.  Active  in  student  government 

, 56)  Which  of  the  following  describe  you  when  you 

" were  in  college? 

'/•■!  1.  A varsity  athlete 

' 2.  Class  officer 

; 3.  In  the  top  1/3  of  my  class 

* ■ 4.  A member  of  several  clubs 

'A  I 5.  A leader  (officer)  in  some  school  club  or 

. organization 

6.  Active  in  student  government 

•sTj 

■-  ] 57)  Which  of  the  following  characterize  your 

' parents'  supervision  of  you  when  you  were 

growing  up? 

1.  Strict 

2.  Fair 

3.  Lenient 

4.  Permissive 

5.  Harsh 

6.  Cruel 
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/IPPENDIX  6. A 

DIFFERENTIAL  MANEUVERING  SIMULATOR  (OMS) 
DATA  REDUCTION  PROGRAMS 


The  data  analysis  package  is  based  on  56  vari- 
ables employed  by  the  DMS  at  a preselected  rate 
during  the  mission,  usually  every  0.5  second  (see 
Figure  6.A-1).  At  the  end  of  a series  of  runs, 
these  data  are  transferred  to  a magnetic  tape  for 
further  analysis.  The  programs  used  can  be  broken 
with  three  major  categories:  (1)  Pretest  programs 


9-1159 


VARIABLE 

DESCRIPTION 

UNIT 

1 

CODE  NUMBER  OF  DATE,  RUN,  PILOT,  AND 

- 

AIRCRAFT 

2 

TIME  FROM  START  OF  RUN 

SECONDS 

3 

RANGE 

FEET 

4 

RANGE  RATE 

FEET  SECOND 

5 

INTEGER  FLAG  FOR  GUN  MISSILE  DATA 

- 

FOR  SPHERE  A 

6 

INTEGER  FLAG  FOR  GUN/MISSILE  DATA 

- 

FOR  SPHERE  B 

7 

X INERTIAL  POSITION  OF  SPHERE  A 

FEET 

8 

r INERTIAL  POSITION  OF  SPHERE  A 

FEET 

9 

ALTITUDE  OF  SPHERE  A 

FEET 

10 

X INERTIAL  VELOCITY  OF  SPHERE  A 

FEET, SECOND 

11 

Y INERTIAL  VELOCITY  OF  SPHERE  A 

FEET/SECOND 

12 

TIME  RATE  OF  CHANGE  OF  ALTITUDE  OF 

FEET, SECOND 

SPHERE  A 

13 

EULER  YAW  ANGLE  OF  SPHERE  A 

DEGREES 

14 

EULER  PITCH  ANGLE  OF  SPHERE  A 

DEGREES 

15 

EULER  ROLL  ANGLE  OF  SPHERE  A 

DEGREES 

16 

NORMAL  LOAD  FACTOR  OF  SPHERE  A 

“G"$ 

17 

LATERAL  LOAD  FACTOR  OF  SPHERE  A 

“G”$ 

18 

ANGLE  OF  AHACK  OF  SPHERE  A 

DEGREES 

19 

ANGLE  OF  SIDESLIP  OF  SPHERE  A 

DEGREES 

20 

BODY  ROLL  RATE  OF  SPHERE  A 

RADIANS, SECOND 

21 

BODY  PITCH  RATE  OF  SPHERE  A 

RADIANSSECOND 

22 

BODY  YAW  RATE  OF  SPHERE  A 

RADIANS  SECOND 

23 

WEIGHT  OF  SPHERE  A 

POUNDS 

24 

THRUST  OF  SPHERE  A 

POUNDS 

25 

SPECIFIC  EXCESS  POWER  OF  SPHERE  A 

FEET, SECOND 

26 

FORE/AFT  STICK  POSITION  OF  SPHERE  A 

- 

27 

RIGMT/LEFT  STICK  POSITION  OF  SPHERE  A 

- 

21 

RUDDER  PEDAL  POSITION  OF  SPHERE  A 

29 

THROTTLE  POSITION  OF  SPHERE  A 

- 

30 

DUMMY  WORD 

- 

31 

DUMMY  WORD 

- 

32  TO  56 

REPEATS  WORDS  7 TO  31  FOR  SPHERE  B 

- 

FIGURE  6.A1  VARIABLES  STORED  ON  DIFFERENTIAL 
NANEUVERIN6  SINULATOR  DATA  TAPE 


digital  models  of  Air  Combat  Maneuvering  (ACM),  the 
Adaptive  Maneuvering  Logic  (AML)  and  the  Analytical 
Simulation  of  Tactical  Air  Combat  (ASTAC).  The 
models  provide  a comparison  of  aircraft  in  ACM  and 
indicate  the  outcome  of  the  maneuvering  given,  the 
starting  conditions  and  the  aircraft  capabilities. 
Other  programs  yield  data  on  specific  excess  power 
during  maneuvers,  constant  excess  power  between 
the  two  aircraft,  and  other  energy  management  sum- 
maries as  a function  of  Mach,  and  altitude.  These 
programs  are  used  to  generate  information  for  the 
pilots  on  the  relative  weaknesses  and  strengths  of 
the  aircraft  being  evaluated.  The  daily  use  pro- 
grams analyze  the  single  run  data  on  a day-by-day 
basis.  They  provide  a check  on  the  operation  of 
the  simulator  as  well  as  a basis  for  the  final 
evaluation  of  the  tests.  A list  of  these  programs 
can  be  found  in  Figure  6.A-2.  The  major  data 
reduction  package  in  this  series  (HASTE)  provides 
time  history  plots  of  all  major  variables  and 
events,  gun  firing  and  missile  hits,  histogram 
plots,  graphical  displays  of  selected  variables, 
and  positional  advantage  summaries.  A list  of 
these  subroutines  is  presented  in  Figure  6.A-3. 

The  post- test  programs  are  primarily  concerned 
with  measures  of  mission  effectiveness  such  as 
aircraft  weapons  and  offensive  performance.  (See 
dashed  boxes  in  Figure  6.A-2.)  They  yield  summar- 
ies of  time  kill  zones  and  probability  of  kill 
data.  They  can  provide  single-run  as  well  as 
multi-run  data  analysis. 

Another  test  design  innovation  used  by  NASA  is 
to  run  a series  of  engagements  using  the  basic  air- 
craft on  an  equal  basis  as  part  of  the  test  design. 
Thus,  during  the  F-4  aircraft  studies,  all  pilots 
were  run  against  each  other  using  identical  F-4 
aircraft.  This  served  as  a baseline  to  evaluate 
the  pilot  effects  across  subject  groups  and  studies. 


which  provide  information  for  pilot  briefings; 

(2)  daily  summary  data  of  simulation  runs;  and 

(3)  post-test  programs  which  provide  analysis  of 
sets  of  runs  for  pilots,  starting  conditions,  and 
other  parameters.  The  pretest  programs  provide  two 
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APPENDIX  6.B 

ADAPTIVE  MANEUVERING  LOGIC  COMPUTER 
MODEL  FOR  AIR-TO-AIR  COMBAT 


Computer  models  for  air  combat  generally  fall 
into  two  types:  the  specific  which  generates  opti- 

mum paths  from  specific  initial  conditions  to 
specific  end  conditions;  and  the  general  which 
attempts  to  utilize  the  classic  maneuver  which  most 
fighter  pilots  would  use  in  a given  situation. 

Both  have  significant  drawbacks  when  applied  to 
interactive  combat  situations.  The  specific  models 
tend  to  be  too  specific,  requiring  complex  iterative 
processes  to  generate  a solution  for  only  one  of  an 
infinite  series  of  situations.  The  time  and  compu- 
ter capacity  required  to  solve  such  models  make  them 
impractical  for  real-time  applications.  The  general 
model  fails  because  many  situations  arise  in  air-to- 
air  combat  where  no  classical  maneuver  is  the  appro- 
priate response.  The  program  has  no  good  response 
to  these  cases.  At  best,  the  classical  maneuvers 
are  general  best  solutions  to  specific  problems  in 
air  combat  maneuvering.  In  addition,  these  programs 
can  require  considerable  modifications  when  aircraft 
characteristics  are  changed.  The  Langley  Research 
Center  chose  to  pursue  an  alternate  approach  called 
Adaptive  Maneuvering  Logic  (AML)  which  would  use 
some  desirable  characteristics  of  both  the  general 
and  specific  approaches  but  develop  along  lines 
essentially  different  from  either. 

6.B.1  AML  MODEL  DESCRIPTION 

Rather  than  using  classical  maneuvers  such  as 
a high-speed  yo-yo,  scissors,  etc.,  the  program  uses 
simpler,  more  elemental  maneuvers.  These  elemental 
maneuvers  consist  of  segments  of  circular  flight 
paths  lying  in  a plane.  The  flight  path  is  speci- 
fied by  the  throttle  setting  and  the  percentage  of 
available  load  factor.  The  bank  angle  is  chosen 
such  that  the  flight  path  remains  in  the  desired 
plane.  The  aircraft  continues  to  fly  in  the  speci- 
fied plane  until  a new  maneuver  is  chosen.  When 
this  occurs,  the  aircraft  transitions  to  a new  plane 
of  flight  by  rolling  until  its  wings  are  properly 
aligned  to  cause  all  net  forces  to  lie  in  the  new 
plane.  The  minimum  time  that  an  aircraft  must  fly 


in  a maneuver  plane  is  an  input  parameter  to  the 
program.  It  appears  that  one  second  intervals  are 
sufficiently  short  to  allow  flexibility  in  reeval- 
uating the  tactical  situation  for  possible  maneuver 
changes. 

This  approach  resembles  the  classic  maneuver 
approach  using  smaller,  more  general  maneuver  seg- 
ments. When  these  segments  are  put  together,  they 
often  resemble  the  classic  maneuvers;  however,  they 
are  tailored  as  responses  to  the  specific  maneuvers 
of  the  piloted  aircraft.  A simplified  flow  of  the 
AML  is  given  in  Figure  6.B-1.  The  program  uses  a 


FIGURE  6.B-1  ADAPTIVE  MANEUVERING  LOGIC 
FLOW  DIAGRAM 
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fixed  logic  to  decide  which  maneuver  to  make  next 
by  predicting  the  future  state  of  its  opponent  over 
a short  time  interval.  It  then  computes  what  its 
state  would  be  if  it  performed  each  of  several 
optional  maneuvers  over  the  same  time  period.  The 
computed  state  of  each  trial  maneuver  is  compared 
with  the  predicted  state  of  the  opponent,  and  the 
most  promising  trial  maneuver  is  chosen  as  the  next 
to  be  performed. 

When  the  program  makes  maneuvering  decisions, 
it  evaluates  the  standard  elemental  maneuver  options 
available  as  a function  of  the  current  tactical  sit- 
uation. A separate  priority  logic  is  also  included 
for  ground  avoidance. 

Under  normal  circumstances,  the  program  evalu- 
ates some  or  all  of  the  following  maneuvers:  con- 

tinuing the  maneuver  it  Is  currently  performing; 
maximum  load  factor  turn  in  its  current  plane; 
maximum  load  factor  turns  in  planes  banked  10°  to 
either  side  of  the  current  plane  of  flight;  flying 
straight;  maximum  load  factor  turns  in  the  "inter- 
cept maneuver  plane"  (the  "intercept  maneuver  plane" 
is  defined  as  the  plane  which  contains  the  computer- 
controlled  aircraft's  current  velocity  vector  and 
the  predicted  position  of  the  opposing  aircraft); 
maximum  load  factor  turns  in  planes  banked  10°  to 
either  side  of  the  "intercept  maneuver  plane"; 
maximum  load  factor  turns  in  planes  banked  90°  to 
either  side  of  the  "intercept  maneuver  plane";  and 
a turn  with  a load  factor  computed  to  yield  a cir- 
cular flight  path  in  the  "intercept  maneuver  plane" 
which  will  exactly  intercept  the  opponent  at  his 
predicted  position.  The  AML  extrapolates  the  oppon- 
ent's position  (and  other  state  variables)  at  the 
end  of  a preselected  time  interval,  nominally  two 
seconds,  from  the  current  time  using  a second-order 
curve  containing  the  opponent's  present  and  two 
previous  positions. 

For  each  trial  maneuver,  the  program  computes 
what  the  state  of  the  aircraft  under  its  control 
would  be  at  the  end  of  two  seconds.  The  computed 
state  variables  resulting  from  each  trial  maneuver 
are  then  compared  with  the  predicted  state  variables 
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of  the  opponent  through  a set  of  questions  which 
results  in  a numerical  score,  the  Adaptive  Maneuver- 
ing Logic  Score  (AMLS),  and  the  maneuver  with  the 
highest  score  is  chosen  as  the  next  to  be  performed. 
The  questions  are  listed  in  Figure  6.B-2.  A y« 
answer  is  given  a score  of  one  and  a no  answer  a 
score  of  zero.  Currently, no  weighting  function  is 
used  beyond  the  one  or  zero  scoring  system. 
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QUESTIONS 

ANSWERS  I 

YES 

NO 

1.  IS  OPPONENT  IN  FRONT  OF  ATTACKER 

1 

0 

2.  IS  AHACKER  BEHINO  OPPONENT 

1 

0 

3.  CAN  ATTACKER  SEE  OPPONENT 

1 

0 

4.  IS  OPPONENT  UNABLE  TO  SEE  ATTACKER 

1 

0 

5.  IS  ATTACKER  IN  CERTAIN  CONE  BEHIND  OPPONENT 

1 

0 

6.  IS  OPPONENT  NOT  WITHIN  CERTAIN  CONE  BEHIND  ATTACKER 

0 

7.  CAN  ATTACKER  FIRE  AT  OPPONENT 

0 

8.  CAN  OPPONENT  NOT  FIRE  AT  ATTACKER 

1 

0 

9.  IS  AmCKER  CLOSING  ON  OPPONENT 

1 

0 

10.  IS  ATTACKER'S  LINE  OF  SIGHT  ANGLE  LESS  THAN  60“ 

1 

0 

11.  IS  ATTACKER'S  LINE  OF  SIGHT  ANGLE  DECREASING 

1 

0 

12.  IS  AHACKER’S  SPECIFIC  ENERGY  RATE  GREATER  THAN 

1 

0 

-30.48  rSEC 

, MAXIMUM  AND  MINIMUM  SCORES 

+ 12 

0 

FIGURE  6.B-2  GEOMETRIC  AND  STATE  COMPARISONS 
FOR  THE  AML  MODEL 


6.B.2  AML  RELIABILITY 

Split-half  correlations  were  run  on  two  sets 
of  four  subjects  who  flew  both  against  each  other 
and  against  the  computerized  pilot  model  (see 
Figure  6.B-3).  Data  were  available  for  three  sets 
of  six  engagements,  two  for  man  against  man  and  one 
for  man  against  model  missions.  Reliability  coef- 
ficients were  generated  for  all  combinations  to 
check  for  sampling  error.  Although  a number  of 
changes  in  the  simulator  were  made  during  the  inter- 
val between  this  data  set  and  the  previously  reported 
data  set  (see  Section  6.5.3),  it  was  felt  that  useful 
indicators  of  measurement  consistency  could  be  ob- 
tained. Comparing  the  reliability  measures  with 
those  from  the  previous  set  (r^  found  that 

time  on  offence  (TO)  and  time  on  offence  with  advan- 
tage (TOA)  were  still  unreliable  performance  measures 
The  AMLS  measure  yielded  an  almost  identical 
reliability  coefficient  (.81  versus  .82)  to 
the  first  group  of  subjects  further  substantiating 
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its  value  as  a performance  measure  (see  Figure 
6.1-16).  Kills  data  were  not  available  for  this 
group. 

Comparisons  were  made  of  all  measures  and  com- 
binations of  groups  (A,  B,  A+B/2  versus  model)  with 
the  scores  generated  in  the  pilot  versus  model 
encounters.  These  comparisons  serve  as  an  indicator 
of  whether  the  measures  are  evaluating  the  same 
thing  and  how  well  they  are  measuring  it.  While  the 
correlations  obtained  were  low,  the  lack  of  relation- 
ship is  mitigated  by  a numer  of  factors  and  does 
not,  at  this  time,  eliminate  the  pilot  model  as  a 
tool  for  evaluating  pilot  performance.  The  data 
used  to  generate  these  coefficients  were  obtained 
on  an  £d  hoc  basis  and  represent  the  results  of  a 
preliminary  model.  Both  the  model  and  the  simula- 
tor have  gone  through  another  generation  of  improve- 
ments, and  it  is  quite  possible  that  new  data  will 
show  a significantly  improved  relationship.  A 
proper  evaluation  would  require  a blind  study  where 
pilots  were  not  told  whether  their  opponent  was  the 
model  or  another  "live"  pilot  and  a minimum  of  12 
subjects  run  over  at  least  six  engagements  for  both 
model  and  live  encounters. 
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MEASURE 

TIME  ON  OFFENSE 

TIME  ON  OFFENSE 
WITH  AOVANTAGE 

ADAPTIVE 
MANEUVERING 
LOGIC  SCORE 

SIMULATION 

a’ 

B^ 

UJ 
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SUBJECT  1 
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2 

ITVi 
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31.7 

51.7 

58.6 
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5.6 

3 

iif'M 

83J 
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26.9 

15.5 

19.6 

4.9 

4.7 

HI 

4 

iitil 

91.8 

98.8 

52.4 

35.0 

37.8 

5.4 

5.8 

EH 

5 

148.3 

126i 

51.0 

77.3 

47.8 

5.5 

6.2 

5.3 

S 

97.8 

90.8 

138.7 

23.2 

17.7 

71.5 

4.8 

4.8 

5.8 

7 

122.6 

103.1 

127  j6 

48.7 

32.1 

57.3 

5J 

ttl 

5.5 

S 

108.2 

149J 

119.8 

29.5 

63.8 

61.6 

5.0 

m 

5.3 

MEAN 

i 

i 

i 

STANOARO 

DEVIATION 

25.93 

17.10 

11.89 

21.58 

16.11 

0i56 

0.550 

0.385 

'A,  B^ 

0.07 

■ 

0.38 

0.81 

mm 

iilH 

'B.  MODEL® 

mH 

0.23 

-0.01 

'A  t B,  model’ 

0.30 

m 

B 

1.  RESULTS  OF  PILOTS  VERSUS  PILOTS  IN  SPHERE  A OF  OltB 

2.  RESULTS  OF  PILOTS  VERSUS  PILOTS  IN  SPHERE  B OF  OMS 

3.  MODEL  - RESULTS  OF  AML  VERSUS  PILOTS 

4.  THE  CORRELATION  BETWEEN  RESULTS  IN  A AND  B 

5.  THE  CORRELATION  BETWEEN  RESULTS  IN  A AND  THE  MODEL 

6.  THE  CORRELATION  BETWEEN  RESULTS  IN  B AND  THE  MODEL 

7.  THE  CORRELATION  BETWEEN  THE  AVERAGE  RESULTS  IN  A AND  B.  AND 
THE  MODEL 

FIGURE  6.B-3  RELIABILITY  OF  THE  AML  MODEL 
COMPARED  TO  EQUIVALENT  RUNS  USING  LIVE  PILOTS 
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APPENDIX  7. A 

CONTRACTED  PARAMETRIC  PRICE  COMPARISONS 
OF  VARIOUS  ACES  IMPLEMENTATION  DEVICES 

7.A.1  PAPER-AND-PENCIL  TESTING  - See  Reference  (a) 

0 Sample  Program  (six  month  duration) 

Device  general  description  for  selection 
- Paper-and-Pencil  Test 

0 Labor  

- Test  development,  administration  and  validation 

- Application  of  Pilot  Life  Inventory  Questionnaire 

0 Data  Processing  

0 Materials 

0 Facilities:  government  furnished  

0 Total  

0 Complete  ACES  Program  (three  year  duration)  

7. A. 2 AIR-TO-AIR  COMBAT  SIMULATOR  - See  Reference  (b) 

Device  general  description  for  selection 

0 40  feet  diameter  training  station  projection  sphere 

0 A two  place  cockpit 

0 Instructor  console 

0 Multiprocessor  digital  computer 

0 One-on-one  simulation  capability 

0 Target  generators 

0 Hydraulic  control  loading  system 

0 Pneumatic  system 

0 Equipment  monitor  station 

As  proposed  for  training  use  by  U.S.  Navy  

As  modified  for  selection  purposes 
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7. A. 3 JOB  SAMPLE  SELECTION  TEST  DEVICES 

0 Aerial  Gunnery  Device  - See  Reference  (c) 
Device  general  description  for  selection 

- Combined  cockpit/instructors  station 

- Ten  feet  dome  display  system 

- Digital  computer 

As  proposed  for  training  use  in  Reference  (c) 


0 Single  unit 


0 Each  subsequent  unit 


As  modified  for  selection  purposes 


(Thousands) 


0 Single  unit 


0 Each  subsequent  unit  

0 General  Aviation  Trainer  Device  - See  Reference  (d) 
Device  general  description  for  selection 

- General  Aviation  Trainer 

- Microcomputer  system 

- Voice  synthesizer  and  audio/visual  system 
As  proposed  to  Canadian  Air  Force 


0 Single  unit 


0 Each  subsequent  unit 
For  United  States  Air  Force 


0 Single  unit 


0 Each  subsequent  unit 


7. A. 4 CDMPLETE  ACES  PRDGRAM 

0 Dne  set  of  paper-and-pencil  tests 


0 Dne  afr-to-afr  combat  simulator 


0 Tmo  aerial  gunnery  simulators  . 
0 Four  General  Aviation  Trainers 


ID, 333 


14,698* 


♦This  figure  does  not  include  the  cost  for  the  development  of  situational  tests.  This  cost  will 
depend  upon  a number  of  factors,  including  the  nature  of  the  variable(s)  being  assessed  and  the 
complexity  of  the  tests. 
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